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Abbreviations 



El Volunteer students who were randomly-assigned to the AEL 

Experience-Based Career Education Program. 

E2 Volunteer students who joined the AEL/EBCE Program under 

non-random conditions. 

Kl Volunteer students who joined the KCSS/EBCE Program at 

Charleston High School under non-random conditions. 

CI Volunteer students who were randomly 'assigned to the 

control group and remained in their home high schools. 

. C2 Volunteer students who were initially randomly-assigned 

to the AEL Experience-Based Career Education Program 
but subsequently elected to remain in their home high 
schools and volunteered to serve as non-randomly selected 
controls. 

CM I Career Maturity 'Inventory 

CTBS Comprehensive Tests of Basic Skills 

ASA Assessment of Student Attitudes 

. SIQ Student Information Questionnaire 

USOE United States Office of Education 

NIE" National Institute of Education 

AEL Appalachia Educational Laboratory 

EBCE Experience-Based Career Education 

LC Learning Coordinator 

KCSS * Kanawha County School System 
CHS '• Charleston High School 

ETS Educational Testing Service 
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This report: fulfills a requirement of the Appalachia Educational 
Laboratory /Experience-Based Career Education (AEL-/EBCE) contract with 
the National Institute of Education (MIE) that an FY ' 75 Internal 
Kvaluation Report be prepared and submitted to the Career Education 
Program*(CEP) staff of NIE. The report- has been prepared by the evaiua 
tion staff of the Experience-Based Career Education (EBCE) Program of 
the Appalachia Educational Laboratory, Inc. (AEL) . 

The report is principally intended for the NIE Career Education 
Program staff. It is most meaningfully read in conjunction with ether 
program materials which describe the program, its staff, the community, 
and its experience sites. These can be found in the Operational Plan , 
FY 1 7 5 and the Quarterly Progress -Reports . If the reader does not have 
these program descriptions or first-hand knowledge of Model II programs 
of NIE/dEP, he is urged to obtain them from the EBCE Program Director, 
Appalachia Educational Laboratory, P. 0. Box 1348, Charleston, West 
Virginia 25 325. 

The following material is organized into six sections: Section 1 
is ^.n overview of the EBCE program and the EBCE evaluation activities; 
Section 2 describes the student population in terms of baseline data 
for the experimental and control groups; Section 3 presents an overview 
of the internal formative and summative evaluation design; Section 4 
presents the activities and findings of summative evaluation; Section 5 
overviews the AEL/EBCE findings as identified by formative evaluation; 
and Section 6 summarizes findings and conclusions. 

*Now called Education and Work. 
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The Appalachia* Educational Laboratory's (AEL) Experience-Based 
Career Education (EBCE) Program has been in existence for over three 
years. Originally the project was funded by the United States Office 
of .Education (USOE) , later by the National Institute of Education (NIE) . 
Based 'on a USOE 'directive, AEL developed a project that would be a 
community-based ^experienti ally-oriented alternative educational curriculum 
for high school students. 

The first year of operation of the AEL/EBCE Prcgxam was devoted to 
the development and trial of key components of the AEL/EBCE model. The 
second year of operation was spent in revising system components into 
an integrated transportable product. The third year of operation was 
spent in refinement of all sub-systems and materials, in preparation 
for the forthcoming training and implementation cycle of the EBCE 
program. 

Formative Evaluation 

Activities associated- with formative evaluation can be divided into 
four phases: establishment of timelines, finalization of the formative 
evaluation plan, development of neces*sary instrumentation, and finally, 
implementation of the evaluation plan. All phase»s occurred between 
September 1, 1974 and June 30, 1975. 

Timelines established for actual formative evaluation of AEI/s 
Experience-Based Career Education system cover the period between 
October 1, 1974 and June 30, 1975. Since the original plan was revised 
(September) and instruments had to be developed (October through Decem- 
ber) , implementing evaluation sooner than this would have, been impossible. 
The revised formative evaluation plan was implemented from October 1, 1974 

12 



to June 30, 1975, 

Instrument development occurred between October 1 and January 1. 

Each instrument was developed from questions outlined in the formative 

■evaluation plan, according to the priority assigned and the type of" 
instrument projected r it. Instrument development proceeded with 
cJi, effort on ~he of the AEL/EBCE formative evaluation personnel to 

analyze the question and select a strategy for answering it. Existing 

_jEq r majbiv e_ eya lja a t i o n_ i n st rumen t s_- previo u s ly— u s e d_ i n— th e - AEL- a nd -othe r 

EBCE programs were reviewed and then these instruments .were either 
revised; adopted, pr deleted. The instruments were then administered , 

^o" ; -appropriate^ respondent" grcup~sample~sV~r.^ 

a report written. Finally, instrument, revision was initiated when 

■ •■ ° ■ • ' 

■■ i« ... - : . "" ' ■ 

necessary. 

Finalizing, the formative evaluation plan was conducted . in September 
•Since ..the strategies were well explicated in the FY 1 75 Operating Plan , 
only minor' revisions were required. Findings associated with" this „ 
evaluation' are presented in Section 5 of -.-.tliis report. 

Sumihative Evaluation • 

Internal summative evaluation activities consisted of 1) collecting 
and analyzing preliminary data, 2) establishing necessary evaluation' 
contool-ST^^-^i^ai-x^^ 

additional, instruments, 5) administering those instruments, and 6)' 
analyzing the data and reporting the findings. These activities 
occurred from September 1,1974 to. August 31, 1975 and proceeded as 

rp ... . 

described below. External summative evaluation activities involved a 
cooperative effort between A EL apd Educational Testing Service (ETS) 



personnel to collect summative data on students, parents, employers, 
and former students. 

During student orientation for fall, 1974, each student participated 
in a data collection program using standardized instruments. Students 
completed about two hours of inventories and tests. The Comprehensive 
T' ~ ftasic Skills (CTBS) assessed student academic achievement in 

• ■i' J nd ma ' hematics . Demographic data were also collected using 
^h~e~Studen"t^nforma~t^^^^ (BI£)~ r 

According to the summative evaluation plan, t.wo groups of students 
(experimental group and control group) were to be selected randomly 
from the pool of all students that volunteered for the EBCE' program. 
This was completed before student orientation occurred in the fall, 1974. 

At NIE's request, a data analysis plan (in addition to the summative 
evaluation plan) was designed and submitted. Instrumentation was 
developed or secured in time for pretesting and/or posttesting of the 
students and other respondent groups. Posttesting of all EBCE student" 
and control/comparison group students, and obtaining data- from parents, 
employers, and former students took place, in May "and June. Most recent 
.activities have involved tY\e completion of planned test ^coring, data 
analysis ,. and report writing. '' * $ 
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Five distinct groups of students contributed to 'evaluation of the 

EBCE program during FY 1 75. The following sub-sections, describe the 
circumstances and individual programs of each group of students and pre- 
sent data illustrating their comparative characteristics. 

J * • / 

Experience-Based Career. Education Students ; 

There were three different groups of students who actively parti ci- 

• / ' 



/ 



pated in the EBCE program during the 1974-75 school year/ All three 
groups participated in similar programs, and two offthem (El and E2) 
used identical procedures , resources, and facilities, Distinguishing 
characteristics of these three groups were either method of selection 
(random ^3. non-random) or EBCE program (AELi.vs. Kanawha County School 

System-KCSS) . The three groups of experimental students are: 

i ' ■ ■ 

El . ^These 51 students 'were randomly-selected from volunteers, at 

/ ' 

11 Kanawha County high schools .(including Charleston' Catholic High , 



School) who participated in AEL's F CE Program and completed pretests 

and posttests- Thirty-five of these students were /seniors' and 16 were 

. I 

juniors. 

E2 . These students were 22 others who participated in AEL's EBCE 

• • • ■ ' / ' 

Program but were not sufc rHcted to .the random selection process. All 

_ F,7 stnri^nt'c; fnr whnm r^t^ arp RVR 3 1. flhle— were -Seniors-,- — : ■ 



Kl . These students were 11 seniors and five juniors who completed 
Kanawha County" School System's £B'CE Program at Charleston High School 
and took all pretesrs and posttests. 

Control Students 



Two groups of students, were selected from ajnong the ^juniors . and 

16 ' I 



seniors in Kanawha County high schools for purposes of comparison with 
EBCE students. These two groups are described below. 

CI. These students were a randomly-selected group of controls 
from Kanawha County high schools. They. had volunteered to participate- 
in the EBCE program but remained in their home high schools because 
they were not selected to participate in the, EBCE program. 

G2y_- — These— s-tudents—were—non—randomly-s elected— controls™ from 

Kanawha County high schools. Although these students had had the 
opportunity to join EBCE, they, declined for various reasons. .However, 
they did. volunteer to be members of the control group. 

All members of the .control group for whom data were available com- 
pleted their 1974-75 school year in one of 11 county high schools. These 

high schools, offer considerable variance 'in the types of families they 

i • 

serve - from -inner- city to rural to upper middle^class suburban. .Their 
•educational programs are basically traditional; however, variations "of^ 
modular scheduling are used in some. Extensive use of continuolisr pro-:,, 
gress curriculum has also had an impact on several of the. educational 
programs. Many seniors who- require only one or two courses for 
graduation may attend school for as little as one-half day. 

Descriptive Comparisons ~ ' 

— : 7~ - & 

" Questionnaires and tests were administered in the falltof 1974 to. 
all experimental and control groups (El, E2 , Kl, CI , * arid C2) to establish 
the degree' of comparability. Comparisons among groups were made only 
when the data collected Were amenable to legitimate comparisons. 

Student demographic data for all students were obtained utilizing 
the Student Information Questionnaire (SIQ; see Appendix A). Data from 
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this 3IQ were coded and tabulated. A 'summary of these tabulations may 
be found in Table 1. 



18 



ERIC 



Table 1 

Background Characteristics of EBCE and Control Students 



El 
(n=51) 



■ E2 
(n*22) 



Kl 
(n=20) 



CI 
(n=32) 



C2 
(n=14) 



Total 



Total 



El 4 E2 CI + C2 



Variable 


f 


% 






f 


% 


f 




f 




f 




f 


Sex 




























Hale 


23 


4S 


I 1 


r •> 
! 


8 


III 


19 




u 


43 




47 


25 


Female 










12 


60 . 


13 


41 


8 


57 


39 


53 ■ 


21 


Grade 




























■ 11th Grade 


16 


31 


0 


0'. 


5 


25 


•13 


41 


6 


43 


16 


22 


19 


— 12th-Grade— - — — 


-35- 


-69— 


—22400— 


-45- 


-75— 


49- 


-59- 


8 


-57- 


57- 


-78- 


-27- 


Race 












- 
















White 


46 


90 


18 


82 


14' 


70 


29 


91 


13 


93 


64 


88 


42' 




« 4 

4 


. " 


,4 


lo 


■ e. 

0 




J 


Q 
J 


1 


7 


a 

D 


11 


/[ 
H 


Spanish Descent 


1 


2 


: o 


0 


■ 0 


, 0- 


0 


0 


,0 


0 

•,. 


1 


1 ' 


0 


Major Field; of Study 




























General 


28 


55 1 


"8 


36 ■ 


.6 


30 


8 


25. 


3 


21 


36 


49 


11 


• Vocationsl Education 


•10 


20. 


•4 


18' 


,. 4 


20 , 


5 


16 


2 


14 


14 


19 




College Preparatory 


11 


22 ■ 


8 


36 


9 


45;' . 


10 


31 


6 


43 


19 


26 ' 


'16 


Other 


2 


4 


• 2 


9 


1 


5' 


3' 


9 


2 


14 


■ ,4 


6 


. -5' 


No. Response 


: 0. 


0 




■ 0 - 


0 


0 


6- 

• 


19 


1 


7 


_ 0 


0 


b .7 


Reason for Joining- 




























Dissatisfied with last 


























i' 


•' "year's schcal 'program . 


18 


35; 


4 


18 


, 6 


30; 










22 


30 




.'■ Wanted iorc information 




























on careers • 


23 


45 


11 


50 : 


10 


50 










34 


47 ■'. 




Wanted a mere person- 




























alized, program' 


7 


14.' 


' * 4 




' 2 


.10 

J 










11. 


.15 




Heard its an easy program 


0 




0 


^;0 


0 


0 










0 


d 




. Other 


3 


; 6 


3- 


14 


1 


5 . 










6 






■ No .Response- 


0 


• 0/ 


0 


0 


1 


5^ 










. 0 


0 





Table 1 (cont.) 



Variable' 



(if51) 



(b»22) 



Kl 
(n=20) 



CI 
(n=32) 



C2 
(n=14) 



Total 



Father's Occupation 
Professional 

Manager or Administrator 
x Craftsman • 

-Proprietor—- - 



Sales 
clerical 

pWective Service 

■ "technical 
Operative 

' Laborer 

Other\ •■ ' 
1 No Response 

••; v , ■ 

No. of Siblings' Who Dropped' 
Out of School :•• 
. None | ■■' 5 

One ' 

Two. 

Three '•' 

■ No Response ' 



41 


80 


20 


91 . 


18 


90 


30 


94 


12 


86- 


61 


84 


7 


14 


0 


0 


1 1. 


5 ; 


' • 1 


3 


1 


7 ' 


7 


10 


2 


■ 4' 


'. 0 


'0 


0 


0> 


1) 


,'0 


' 0 


0 


2 


3 


1 


■2 . 


1 


5 


0 


0 


0' 


10 


0, 


0 


2 


3 


0 


0 


1 


■5 


' 1 


5 


. 1 


3 ■ 


T 


7 


' 1 


1 



Total 



El + E2 CI + C2 



Mother's Education 










1 




r 
j. 




I 


4 


... , t_ 


% 


f_ 




.less than High School 


16 


'32 


• . "5 


23 


f 6 


30 


5 


16 


5 


36 


21 


29 


10 


22 


High School 


15 


29 


6 


27 


10 


50 


15 


47 


5 


36 


21 


29 


20 ■> 


43' . 


More .than High School 


20 


39 


11 


50 


4 


20 


12 


38 


4 


29 


31 


42 


16 


35' . 


Father's Education 


























3 




Less than High School 


20 


39 


4 


18 


5 


25' 


8 


25 , 


.; s 


36 


24 


33' . 


13 ' 


28 


High School 


16 


31 


8 


36 


5' 


25 ' 


12 


38 . 


• 4 


29 


24 


33 


16 

17- 


35 

-37' 


• More' than High School 


15.. 


.29.. 


.10.. 


45 - 


'.10- 


.50 ;.. 


' 12 


.38- 


■■ 5 


36 - 


—25 — 34- 



8 


16 


2 


9 


4 


20 


7 


22 


0 


0 


10 


14' ' 


7 


15 


14, 


27 


4 


18 




15 


4 


13 


1 


7 


' 18 


25 


5 


•11 


9. 
•2 


18 

~4--~ 


2 


9 

-9— 


3 


15 


7 


22 


. 0 


• 0 


11 


15 


7 


15 


• 2 


~-2- 


~itr — 


~r 


■nr. ~ 


■ 1 * 




■ t: 


5" : 


2 


4 


2 . 


4 


0 


0 


0 


0 


2 


6 


2 


14 


4 . 2 


3 


4 


9 . 


0 


0 


2 


,9' 


0 


0 


1 


3 


0 


0 


2 


3 


•1 


2 


2 


4 


0 


' 0 


0 


" 0 


2 


6 


0 


0 


2 


3 


2 


4 


1 


2 


1 


l "5 


3 


15 


1 


3 


0 


0 


2 


3 


1 


2 


3 


6 


4 


18 , 


3 


15 


2 


' 6 


0 


0 


7 


10 


2 . 


: 4 • 


7 


14 


1 


5 


1 


■ 5' 


3 


9 


'5 


36 


8- 


11 


8 


17 


3 


6 


1 


5 


0 


0 


1 


3 


4 


29 


. '4 


5 


5 


11 


0 


0 


3 


14 


: 1 


: 5 ... 


1 


3 


1 


7 


3 


. 4 


2 


5 



♦Includes responses referring, to Occupational Categories mentioned, only once ■ 
. (e.g., homemaker, military service, service) and non-classifiable responses. 
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42 , 91 

" 2. 4 ' 

0 ■ 0 

2 4, 



H 
0 
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Comparisons of Demographic Data . Intergroup comparisons revealed 
that groups El, E2, Kl , and C2 were" highly similar with regard to sex dis- 
tribution; there were between five to ten percent more females than 
males in each of these groups. In group CI, however, this pattern was 
reversed; 59% of this group was male and 41% was female. 

As in previous years of program operation, most EBCE students this" 
year (El and E2) were seniors . Group El was composed largely of seniors 
(69%), while the members of group E2 were all seniors. The control 
. gro up.s . _.( CI. . and_C2 ). each .. contained „ atout. J5 0% . seniors and _ 40 % j uniors . 
The Kl group was made up of 75% seniors and 25% juniors. 

Comparisons of major field of study showed that 55% of students 
in the El group and 36% of students in the E2"group were enrolled in , .' 
a general course of studies, whereas smaller proportions of Kl, CI, and 
C2 groups (30%, 25%, and 21% 'respectively) were enrolled in this type 
of program. In the Kl , CI, and C2 groups, more students were enrolled 
in college preparatory programs than in any other .major field of study. 

In all groups, the majority of students were white; group Kl , which 
Consisted totally of Charleston High School students, included the 
highest proportion of non-white students (30%). These proportions seem 



to reflect the distribution of racial groups among the various Kanawha 
County schools represented rather than any selection bias. 

\ v . , . • . 

Data on students' family background demonstrate that El, Cl , and 
C2 students were fair.ly similar with regard to father's education. In ■ 
each of these- groups , about one-third of the students' fathers had less' 
than a high school education, approximately another ' third had fathers 
who were high school graduates, and almost the same proportion had fathers 
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with post-secondary education. Groups El and C2 had the highest pro- 
portion of fathers with less than a secondary school education. Students 
from group Kl tended to come from families where the father had soir-.e 
post-secondary school education; students from the E2 group tended to 
come from families where both parents had pursued post-secondary education 

In groups El and Cl students 1 mothers were better educated than 
the fathers. In groups E2 and C2 , the educational levels attained by 
the fathers and mothers appeared to be similar. Fathers appeared to 

.be. -better, educated- than .mothers .. in..: the.„ Kl..gro.up... . ..... 

.Fathers "of students in the El group tended to be employed in high- 
status posi.tions. Forty-three percent of the fathers of students in 
this group were employed in professional or managerial positions. Only 
seven percent of C2 s-tudents 1 parents held such jobs. The other three * 
group's (E2, Kl , and Cl) fell between these two extremes, with 27%, 35%, 
and 35% respectively. ■ \ ' 

Most students did not have any. siblings Who dropped out of school; 
of those who did, the largest proportion was found ^ in the El group, 
where 14% (n=7) of the students held one sibling who dropped out of 
school, 4% (n=2) had two siblings who dropped out of school, and 2% 
(n=l) had three siblings who dropped out ^ In. group E2, one student (5%) 
"had three siblings .who dropped out of school. in each of the other 
groups (Kl, Cl, and C2) , one student reported having one sibling who * 
dropped out of school. 

Comparisons of Academic Achievement . All five groups of students 
v/ere administered i:hree subtests of the Comprehensive Tests of Basic 
Skills (CTBS) in September, 1974. Statistical analysis of the test scores 
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(See Table 2 ) indicated that there were no significant differences in 
academic achievement between the true experimental group (El) and the 
true control group (CI). No other comparisons were made, since the E2 , 
C2, and Kl groups were not randomly- selected "and therefore were assumed 
to be non-equivalent to the other two- randomly-selected groups - 

Summary 

Data collected on the five groups of students involved with the 
evaluation of the EBCE program indicated that r.o real differences 
initially existed between the groups. They were similar with respect 
to sex distribution, race, father's education level, number of siblings 
who dropped out of school, and level of academic achievement. 



Table 2 



Statuary of CTBS Pretest Data 


■/. 


El 




CI 


* 








Jjp51) 




_ (n=33) 








, .Subtest'' 7 


X 


s.d. 


X 


s.d. 


F* 


— 




31 64 


7 Sfi 

/ ■ JO 






u. /o 


U.Di 


Arithmetic Concepts 


18.88 


5.87 


17.45 


6.42 


1.09 


0.-30 


Arithmetic Application's ' 


12.59 

" I. 


4.57 


.11.79 


5.25, 


'0.56 


0.54 



*F j 90 (1,79) -.2.38- 



Section 3 
Evaluation Design 
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During tin- develops: >f an educations 5 program, - he?r r ~ vore -iany 
.~:iacisions than had to be ^de by the develo^r^nt or program staff . 
>ome decisions were based upon past researdh and experier, but 
^ther decisions were reached only as a funcri^n of the collection; and. 
dialysis of data as the program was in operation. 

There were also decii: ::_nns to be made by persons other than c:;;e 
rrogram staff. The Labor at: or y administratdon could, upon advicre of 
^ae Board of Directors or other influential, advisors, change the 
direction of the program. Was -he course of the EBCE program in ..line 
with the needs and priorities established for the region „ state, or 
country? If a decision to change the direction or style of the 
program was to be made, then decisions regarding the appropriateness 
of associated personnel to carry out the newly-directed program must 
also be made. 

Similarly, the funding agency miast make- decisions about the 
p rogram which are crucial to the existence of the program. In terms 
of short-range type decisions the funding agency must decide whether 
EBCE was still needed and then whether AEL had a need to produce an 
EBCE version of its own. The funding agency had to decide whether 
AEL had maintained its capacity to produce a quality EBCE program. 
They also had ro decide whether the EBCE program; was unique in its 
approach to alternative education and whether the integration of 
the systems had occurred. In terms of long-range decisions the 
funding agency had tp decide if the EBCE program would produce the 
outcomes- stated in the FY 1 7 5 Operational Plan , and in the process of 
updating the evidence for such an initial decision, the funding agency 
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had to decide if an appropri 7roundv-;-~rk had been laid to insure 
that s±ated outcomes were pr: \'u<>ed. The funding agency also he-.d to 
decide whether or not the go..- * f the EB'CE program was congruence virh 
the needs and priorities of juntry as mandated by the f&zi~zl 

govemment. 

Finally, the potential" ccr r.rn^ier must decide whether the meu-£\zred 
outcomes of using the EBCE pro:rrs*m warrant the expenditure of resources 
required for implementation. Tr recap-iriv-ity of the product user also 
filters back into the decision-ir_uking process of the funding agency. 

Evaluation Areas 

The evaluation of the AEL/E3CE • program involved two ma; : ; 
thrusts — Formative Evaluation and Summative Evaluation. Both 
forms of evaluation had a similar function — that is ,to delineate, 
obtain, and provide information to decision-makers for judging decision 
alternatives. The differences between the evaluation efforts was a 
function of the intent of each. ' 

Formative Evaluation attempted ro assess the value of individual 
program components to insure that every component worked as well as 
possible, both in isolation and as it meshed with other components. 
It is a process which sought information; to answer those questions 
critical to the rational decision-making necessary to accomplish the 
scope of work. 

. The primary concern of Summative Evaluation was to assess the 
effectiveness of both the AEL/EBCE propsirt -in terms of student 
attainment of project objectives and in terms of the viability of 
the project as an alternative to * VdUitioialtl secondary education. 

30 



The infcrrratior .rrc-.ricied by the sicnma:. evaluation will usee: by 

decisic -makers t.rr r::;ajor program mod .nations and f unci trpz decisions. 

The iiValuarj_.OJi design was deLin^at—L in three different are. as : 
External Suimat^tfe, Internal* 5umniati"*e , and Internal Formative. 

Estsmal Suinmarr:.ve Evaluation 

The ICIE selectefd the Educational Testing Service (ETS) to do an 
external s.ummative evaluation of the 'AEL/E3CE program (e:nd EBCE programs 
at three other Laboratories) . Since development of the external design 
was the responsibility of the external " tractor, no attempt will be: 
made here to delineate those designs and/cr* analytical procedures develops 
by ETS which arei pertinent to providing the funding agency with evidence 
regarding produrrt effectiveness. However, AEL/EBCE did engage in the 
•••following activities with respect to ETS and its external?- summative 
evaluation contract: The internal evaluation staff: 



a. Provided on-going liaison between ETS and project staff 
and betweien ETS and all respondent groups sp^ified in 
the work statement and contract of ETS; 

b. Assisted ETS in the clarification of relsii ..ships between 
project processes, activities, and outcome jectives ; 

c~ Assisted ETS in the search for appropriate instruments; and 
d. Reviewed ETS-develLoped instruments prior tra use. 
However , dsta preparation was th*r responsibility c ETS which submitted 
to the internal evaluation staff duplicate irets of iatia after data were 
collected. • 

3i 
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Internal, jimmatiye Evaluation. 

Th£ primary objective of the internal summative evaluation was to 
assess " ; e effectiveness of tihe EBCE project not only in terms of 
stucLsn-:- .attainment: of project objectives hut also in terms of the 
viabilirrrr of the project as an alternative to traditional secondary 
educatir n- The tasJcs briefly outlined below include the aiCtdvitics 
relatsc .:o internal summative evaluation activities. 

The internal evaluation S-aff of the AEL/EECE prefect, had ths-- 
responsibilities of: 

a. selecting appropriate ccntrol group students - 

b. taking appropriate steps to ensure that • suffziziensfc numbers 
of control students were maintained so that arrprpprxate 
statistical analyses could be performed; 

developing- or securing instruments for objectives unique 

to our- individual prcr >ct ; ; 
d, reviewing instruments designed to measure common objectives; 
■5. administering standardised tests; 

f. providing as needed available longitudinal data at all 
respondent groups ; 

< 

q, maintaining a set of data files necessary for the infcerni^l^ 

summative evaluation; 
h- submitting to NIE by February 28 , 1975, the required FY r T3 

data Analysis plan; 
i. analyzing all data r*?1 <t&& to HrHt owm p^ro^ct miUmittim 

% analysis report as paurt of the end-ojf-^ear evaluation 

report; 0 and 
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3. wz'i.i.-iri.g and submitting quarterly progress reports and final 
rsp:-:ms whicri adhered to NIH/CE? guidelines for - reporting 
lozr~ f schedule .rxi canter.*.. 
The = v a . u a ^ .1 en di ire ctor <a 1 s o visit— d c t h =*r EBC3 pr o j e c t s dur ing FY 1 7 5 
as part off rh.- jclnt evaulaaricn meetings, and presented papers on the 
EBCE evaii:;~~ion at the AUTKk conversion in Washington, D.C- 

Des^^:-. . Although tine A EL /SB Ci: FY 5 7 5 Data Analysis Plan (See Appendix 
B) e.-cp lie Mires the des ign of th^ internal senranati^e evaluation in greater 
detail, a orief description is provided to enhance the continuity of 
tree reporr^ Basically , five croups of experimental and control student^ 
wer?2 established during pre- treatment'. i± ■.cr.uitrme.71c selection.. 
Girrups E_. ^.nd CI wer e es-rablisn^d m order that direct" comparisons 
u.:r ier experimental design condi ~ ; ~>ns roul 1 h-n iruade. (Groups E2 and 
CI u ';. re comprised of r-^-ous cc-mbincicconi: c:f non- i^iiciatnly' selected si:u— , 
der. t.- .nr. :! w/er- to be usee, for investigations, und^rr quasi-experimental 
co: r djLti . ns ~roup SCI jronsiste.: of ch^se sxude;. zs enrol-Led at Charleston 
Hie Sc^oc.-. in a nearly auronocn . :sl v -operated EP : situation. 

Da.ra ./ere gathered from thete groups through che administration of 
the following instruments : 

a. Student Information Questionnaire (SIQ) - This instrument was 
constructed to provide b as: < ■ \ i n e d. j ta :>n ; r. t ch ar i<i c te r- 

i ^ i r . 

f;. C\^m u,- : .::v^. : ^-V>; fusts of -Basir Skills xCTgS' i - This standard- 
ised test of basic aca.u3mic performance contained a reading 
comprehension , arithm^ '. ic concepts , und arithmetic applica- 
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tions sub~es"rs. 

c Career Maturity inventory (CMI/ - This standardized test con- 
tained a ra^rrs-er attitude scale and sub tests of several areas 
of career-related competencies. 

Assessment o:^ Stradent Attxtudes (ASA) : - This instrument 
(developed by Research for Better Schools) assessed students' 
attitudes and opinions toward their academic and career education 
pro grants . 

? ; h.>o £'^P was adniriisrered tc alJ- grc^ips at the beginning of the 
school ^'ear to gather inf oraatic :;i ctt z\an-. criterion variables. The CTBS 
was us.ed with all five groups ±r. a prye-past fashion to assess program 
effects, .^ne .=£3 A was • clmini^rtenred ^ post- treatment instrument to all 
five c;. ..-upS' ♦ TThe OH was admin^:~^~:ed in a post-treatment fashion to 
groups Kir "1 r -1~ ; - nci and ir. a 7 ^o-post fashion to group Kl. Table 3 
confc^ir^s cr list, of zz^- In^trame^inrs ->?id the administration schedule. — 

Table 2 

Inst^-tfent Administration Schedule 
by S Ludvjnt Groups 



Instrument Pretest Posttest 
p&xt* rT74 May 1974 



siq - 1, £2, ci, Kl 

CESS* m, E2, CI, C2„ 1~1 El, E2, CI, C2 , Kl 

El, E2, CI, C2, Kl 

cmh ei, E2, ci,' c2, ki 
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Once the groups of students were identified, appropriate instruments 
were selected to test nine hypotheses which were generated to evaluate 
student growth or student effects as a function of participation or non- 
participation in the EBCE program. 'These hypotheses dealt with basic, 
academic skills, career knowledge, career maturity, and attitudinal 
development. 

Although students are the main group affected by the EBCE program, 
other repondent groups are also impacted by its implementation and 
subsequent operation. Parents and employers are two such- groups which 
weire administered instruments to determine their attitudes toward the EBCE 
program. Similarly, students who 'iad graduated from the EBCE program 
in 1973 and 1974 were also assessed as to their attitudes toward learning 
environments . or job satisfaction. 

Appropriate statistical analyses were performed on the data after 
collection and aggregation. The results of those analyses are reported 
in this final evaluation summary. 

Internal Formative Evaluation 

The internal formative evaluation staff focused its attention on 
three major areas: The AEL/EBCE project, the EBCE project being run 
by the Kanawha County* School System (KCSS) , and a comparison of the 
two projects. The information produced and documented' by the KCSS field 
test provided new information relating to the rep? ication of the EBCE 
program and the impact of external operations on the integrity of the 
EBCE concept. This information should prove invaluable in FY 1 76 when 
replication and dissemination of the EBCE model begins. 
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A set of formative evaluation questions common to both projects 
were indentified using past knowledge and projected items - of concern 
for the KCSS operation. All the questions identified were relevant 
to one of four categories: 1) the EBCE delivery system, 2) the impact 
of program on students, 3) the knowledge of implementation variables, 
and 4) the relationship to experience sites. The following information 
was generated for each formative evaluation question : (a) Site 
specific information (AEL, KCSS, or both), (b) focus of the question, 
(c) instrumentation, (d) time schedule for collecting data, and (e) 
results of assessment. 
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Section 4 
Sujmmative Evaluation 
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As in FY' 74, the primary objective of suimaative evaluations during 
FY "7 5 was to provide valid and reliable evidence of the effectiveness 
of cne EBCE program. urogram objectives were* identified, and 
hypotheses were formed around which a research design was developed 
U^ee Appendix B) • In this section, outcome data pertaining to students, 
paireints, employers, and graduates are presented, analyzed, and 
evaluated. * 

Statistical analyses were selected to test the main effects and 
other effects associated with each hypothesis stated in the AEL/E3CE 
?Y f 75 Data Analysis Plan. Descriptive statistics and correlated t- tests 
wore used to describe groups and measure gains within a given group (if 
appropriate) - A univariate analysis of variance was used to determine 
whether differences between groups existed within the basic academic 
skills mastery, career knowledge, career maturity, and attitude 
towards learning environment variables. An alpha value of .10 or less 
was determined to be satisfactory to warrant assumption of "the existance 
of a significant difference. 

Program Impact and Program Effects 

The impact and effect of the EBCE program on various respondent 
groups was determined by testing a number of hypotheses. The format 
of this section is to state each hypothesis, give the sources of the 
data collected to test each hypothesis, the procedures used for hypothesis 
testing, a description of the findings, and a summary. 
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A. Hypothesis #1 

The first hypothesis to be tested was that AEL/EBCE students in the 
El group will acquire increased (p<.10) mastery in basic academic skills 

1. Data Source 

The data used to evaluate this hypothesis were El students' 
scores on each of three subtests of the Comprehensive Tests of Basic 
Skills (CTBS; See Appendix C) . The CT3S was administered to El 
students in September and May. 

2. Procedure 

The pretest and posttest mean scores of El students on three 
CTBS subtests (Reading Comprehension, Arithmetic Concepts, and , 
Arithmetic Applications) were examined. Then, correlated t- tests' 
were performed to determine whether El students had made significant 
gains (p<\10) in basic academic skills during the 1974-75 school 
year. 

3. Findings 

" . Table 4 shows the results of correlated t-tests (one-tailed) 
on pretest and postest CTBS subtest scores. El students showed 
no significant (p<.10) gains in basic academic skills, as measured , 
"by the three CTBS subtests, over the 1974-75 school year. 

4. Summary 

Hypothesis #1 was rejected; AEL/EBCE students in the El group 
did not show increased mastery in basic academic skills. However, 

y 

one goal of the program was that AEL/EBCE students wpuld do as well 
in basic academic skills as students enrolled in traditional high 
school programs. This goal is, tested in hypothesis #2. 
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; Table 4 

Correlated t-tes.ts on Pre/Post CTBS Scores of 51 El Students 







Reading 
Lumpr triieno xon 
(45 items) 


Arithmetic • 
concepts 
(30 items) 


•Arithmetic 
Applications 
(20 items) 




mean 


31.64 


18.88' 


12.59 


Pretest 


s.d. 


7.58 


5.87 


4.56 




mean 


32.00 


19.24 


12.94 


Posttest 


s.d.'' 


8.92 


5.47 


4'.67 




t-test* 


- +0.40 


3 +0.72 


+0.92 




r 


0.72 


0-81- 


0.82 




= 1.30 


»> 
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B. Hypothesis #2 / 

The second hypothesis was that experimental students (El) would do 
as well in basic academic skills as control students (CI) enrolled in 
traditional high school programs. 

1. Data Source 

:. ■ 

The data used to evaluate this hypothesis were El and CI 
students 1 scores on each of the three subtests of the Comprehen- 
sive Tests of Basic Skills (CTBS) . El and Cl students were 
administered the CTBS in September, 1974, and again in May, 1975, 

2. Procedure . 

The pretest and posttest mean scores of El and Cl students on 
the three CTBS subtests (Reading Comprehension, Arithmetic 
Concepts, and Arithmetic Applications) were examined and compared 
to determine whether El students or students in the randomly-selected 
control gtoup (Cl) had acquired significantly greater (p<\ 10) mastery „ 
i"n~b~asxc™a cad emi c s k i 1 Is. C omparisbns we r e mad e utilitzing an 
analysis of variance procedure to test the equivalence of El and Cl 
groups on the C.TBS subtests scores at~the beginning and at the end 
of the 1974-75 school year. (The ANOVA of pretest /scores was conducted, 
to determine if covariance techniques were applicable.) 
3 * Findings ' 

Means and standard deviations ■ on pre-post CTBS scores are 
presented in Table 5. The El and Cl .groups were equivalent with 
respect to their performance on the CTBS at the beginning of, the 
year, thus negating the need for covariance techniques (See Table 6) * 
The ANOVA of posttest scores indicated no signi ficant difference's 
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between the two groups of students on the three CTBS subtests (see 
Table 7) . ' 
4 . Summary 

Hypothesis #2 was not rejected; experimental students (El) did, 
as well -as control students (CI) in traditional high schools, in 
basic academic skills. It appears that there was little difference 
in the' performance of these two groups (El and CI) on the three CTBS 
subtests. 



Table 5 



Means and Standard Deviations 
on Pre-Post CTBS Scores 
El and CI Students H 



Pretest 



Posttest 



range 



mean 



s.d. 



range 

mean 
s.d. 
n 



Reading 
Comprehension 
(45 items) 



El 



CI 



11-42 



9-43 



31.64 . 30.06 18.88 \ 17.45 



7.58 9.00 



"51 



33 



10-44 

8.92 
51 



6-45 10-28 



30.33 
9.78 

30. 



Arithmetic 
Concepts ' 
(30 items) 



El 



CI 



9-30 



7-30 



5.-87 6.42 



51 



33 



6-30 



19.24 18. 37 
5.47 6,'70 
. 51 30 



Arithmetic 
Application 
,(20 items) 



El 



51 



2-20 

112.94 
4.67 

. 51 



42 



Cl 



4-20 ' 4-20 



12.59 11.79 



4.56 5.26 



'33 



3-19 

11.70: 

'5;03 

30 



30 



Table 6 

ANOVA on CTBS Pretest Scores 1 * 
El V<: CI 



Variable 



Source 



df 



MS 



Reading 
Comprehension 



Group 
Residual 



1 
79 



50.43 
64 . 64 



0.78 



0.62 



Arithmetic 
Concepts 



Group 
Residual 



1 
79 



40.85 
37.52 



1.09 



0.30 



Arithmetic 
Applications 



Group 
Residual 



79 



"12783T 
22.91 



"G75B" 



0.54 



*Sample size: n (£1) = 51 r n (cl) = 33 
**F 90 (L f 79) = 2.78 



Table 7 

ANOVA on CTBS Posttsst Scores* 
El vs CI 



Variable 



Source 



df 



MS- 



F** 



Reading ' 
Comprehension 



Group 
Residual 



1 

76 



52.47 
75.94 



0.69 



0.59 



Arithmetic 
Concepts 



Group 
Residual 



1 

76 



14.25 
36.17 



0.39 ° 



0.54 



Arithmetic 
App 1 i ca t io ns 



Group . 
Residual. 



1 
76 



29 u . 10 
23 . 03 



1>.27 * 



0.-26 



*Sample Size: n 



(El) 



51 ' n <ci) - 30 



**F (1, 76) = 2.78 
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C. Hypothesis 

The third hypothesis was that experimental students- ; (E1) will acquire 
significantly greater (p < . 10). mastery in career knowledge than control 
students (CI) in traditional high schools. j 

1 . Data Source j ~ 

The data, -used to eva^luaj^^ were the El and CI 

students' scores oa^ttie Competence Test of the Career Maturity Inven- 

tory (C MI) . The five s ubtests ofLj^^J^^^ 



Knowing Yourself, 2) Knowing About Jobs, 3) Choosing A Job, 4) Looking 
Ahead', and 5)- What Should They Do (See Appendix D ) . El and Cl stu- 
dents were administered -the CMI in May T , L975. 
2. Procedure 

The posttest mean scores of- El ind Cl students on the five CMI • 
Competence Test subtests were cornpnred utilizing analysis of variance 
. techniques to determine whether El students had acquired significantly 
greater (p < . 10) mastery in career knowledge than Cl students. 
3/ Findings' ] 



Means and standard deviations on posttest CMI Competence Test, 
subscores are presented in Table 8. The A NOVA .of posttest scores • 
indicated no significant differences between the two groups of stu- 
dents .on the five CMI knowledge subtests "(See Table 9 ). 
4. t Summary \ •, 

-Hypothesis #3 was rejected; El students did not acquire signifi- 
cantly greater (p < . TO) mastery in career knowledge than Cl students 
in traditional high ' schools ; " ;1 
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Table 8 

Means and Standard Deviations on CHI Posttest Scores 
El and CI Students . 



7 ' 

i 

i 


Attitude . 
Scale • 
(50 items) 


Knowing 
Yourself 
(20 items) 


Kriowing 
About Jobs 
120 items) 


Choosing 
A Job 
(20 items) 


Looking 
Ahead 
(20 items) 


What Should 
They Do 
(20 items) 


• 


El CI 


El CI 


El CI 


'ei CI ' 


' El CI 


El CI 


' range 


19-46 .22-44 


HU.-15_ 


to 

7-20 6-20 


3-19 4-18, 


_.4-I4 2-18. 


_..>Hc .2-18. 


mean 


36.47 33.50 


13.14 13. D 


15.67 14/97 


t 

12.55 12,23 


12.62 12.67 


10.41 U.63 


s.d. 


6,31 6.02 


' 3.72 3.79 


3:40 3.86 


3.73 4.03 


4,19. 4.05 


3.21 3.51 


Ti 


51 30 


51 30 


51 30 


.51 30 


51 30 


■ 51 30 

L 



.46 - 

45 ■ . ' ■ '- . ■ _ 

•i , ' . 

c . 

O 
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. . Table 9 

A NOVA on CMI t .Posttest Scores* 
Ei vs. CI 



Variable 



Source 



df 



MS 



Knowing Yourself 



Group 
Residual 



1 

76 



1.47 
12.87 



0.11 . 0.74 



"TjToWing About Jobs" 



Group 1 14.30 

Residual 75 ,"11714" 



1.28 0.26 



Choosing A Job \ 



V 



Looking Ahead 



Group 1 3.74 0,28 

Residual 76 13.38 



Group 
Residual- 



1 
76 



0.10 
17.25 



0.01 



0.60 



0.94 



What Should They Do ! 



Group 
Residual 



1 

76 



0.85. 
11 . 28 



0.08 0.78 



{ SBmp±e size: n ( £i )— — 50~7 rrfciy 



**F -90 (1,76) = 2.78 



47 
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D. Hypothesis #4 

The fourth hypothesis was that experimental students (El) will 
acquire significantly greater (p <, 10) career maturity than control stu- 
dents (Cl) in traditional high schools. 

1. Data Source 

The data used to evaluate this hypothesis were the El and Cl 
students' scores on the Attirunss Scale of the Career Maturity Inven- 
tory (CMI). El and Cl students were administered the CMI- in May, 
1975. 

2 . Procedure 

The- posttest mean scores of SI and Cl students on the CMI 
£ttitirfe Scale weu^ compared utilizing ANOVA techniques to determine 
whether El students had acquired significantly greater (pClO) 
career maturity than Cl studen-ra^ 
1. bindings 

Means and standard deviations on the posttest CMI Attitude Scale 
scores are presented xn Table 8* The ANOVA of posttest scores 
indicated "that "the El students had significantly greater (p<.02). 
career maturity scores than the Cl students (See Tabl^ 10) . 
4 . Summary 

Hypothesis #4 was not rejected; the EBCE students did acquire 
significantly greater career maturity than comparable students » 
enrolled, in traditional high schools. 
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Table 10 

ANOVA on Posttest CMI Attitude Scores* 
El vs. CI 



r- 



Variable 



Source 



df 



MS 



Atti tude 



Group 
Residual 



1 

76 



199.27 
34.98 



5.70 



0.02 



*Sample size; 



**F <9Q (1,76) 



,2.78 
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E. 'Hypothesis #,5 

The fifth hypothesis was that experimental students (El) will 
develop significantly more positive (p<.10) attitudes toward learning 
environments than control students (CI) in traditional high schools ; 

1. Data Source \ 

The data used to evaluate this hypothesis were the 'posttest 

- • \ 

score s~o^ ; E1— ani3-CI^^udents^rr"the-^^5e^5Tnent o f" Student 



Attitudes (ASA) instrument (See Appendix E) . The ASA has four 
subtest scores (Attitude towards Education in General, towards 
School Curriculum, towards School Resources, and towards School 
Counseling) and a composite score (Attitude towards the Total 
Learning Environment) . The AS$ was administered to El and CI 
students in May, 1975. 

2. Procedure 

i 
i 

Since the ASA utilizes a Lijkert-type format for item responses 

— with— some-^emsn?ossessi~ng— revex'^ed^pol^rl-ty 

■ ; points rather than actual response scores were analyzed. ANOVA ' 
techniques were used to determine whether El students Jeveloped 
significantly more positive (p<.10) attitudes toward learning 
environments than CI students. 

3. Findings 

Means and standard deviations on the posttest ASA scores are 
presented in Table 11. The ANOVA of posttest scores indicated 
that the El students had significantly more positive attitudes 
toward learning environments than the CI students (See Table 12) . 
Significant differences were found for each subtest of the ASA and 
for the total ASA score. • 



Table 11 



Means and Standard Deviations on Posttest ASA Scores: El and CI Students 



Education , school 
in General Curriculum '• 
(35 points) (25 points)' 



Total 

School school Learning- 

Resources , . Counseling Environment 
points) (25 points) (130-points) 



El 



CI 



El 



CI 



El 



CI 



El! 



CI 



El 



CI. 



9 " 3S 12 " 34 ' 9 ~ 25 ' 9 - 25 1H5 18-44 8-25 5-23 42-126 53-116 

22,80 20.43 17.47 3TtT^OT— lOT-^iaf TSOS" "^37 

4 ; 82 / 5 * 40 | 3 - 13 ' 4.11 , 4.99 6.89 . 3.47 4.43 13.81 17.25 

51 . ' 30 ' 51 .30 51 ' 30 51 



30 



51 



30 



! 
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Table 12 



ANOVA on Posttest ASA Scores* 
El vs CI • 



Variable 



Source 



df 



MS 



p** 



-.Education 
In General 



Group 
Residual 



1 
'76 



•716.93 
26.14 



27.42~ 



0.0001 



School 
Curriculum 



Group 
Residual 



1 
76 



166.02 
12.23 



13.57 



0.0007 



School 
Resources 



Group 
Residual 



1 
76 



1302.49 
33.77 



38.56 



o.ocor 



School 
Counseling 



Group 
Residual 



1 

76 



330.72 
15.22 



21.73 



0.0001 



Total. 
Learning 
En v ir onm e n t 



Group 
Residual 



1 
76 



8824.00 
234.18 



37.68 



0.0001 



♦Sample size: = 51 ' n (ci) ~ 3a ~ ' ' 



**F ; 9Q (1, 76) = 2.78 
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4 . Summary 

Hypothesis £5 was not rejected; the EBCE students did possess 
at the end of the school year significantly more positive attitudes 
toward the learning environment than did the control students in 
traditional high schools. 
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F. Hypothesis #6 

The sixth hypothesis was that experimental students (Kl) will ac 
quire increased (p < .10) mastery in basic academic skills.. 

1. Data Source 

The data used to evaluate this hypothesis were Kl students' 
pretest and posttest scores on each of the three subtests of the 
Comprehensive Tests of Basic Skills (CTBS) . The CTBS was admin-, 
istered to Kl. students in September, 1974 and May, 1/9 7 5? 

2. Procedure 

The pretest and posttest mean scores of Kl students on three 
CTBS subtests (Reading Comprehension, Arithmetic Concepts, and 
Arithmetic Applications) were examined. Correlated t- tests were 
performed to determine whether Kl students had made significant 
gains (p < , 10) in basic academic skills during the 1974-75 
school year. 
• 3. Findings 1 

Table 13 presents the results of the correlated t-tests 
(directional) on pretest/posttest CTBS subtest scores. Kl stu- 
dents showed no significant (p < .10) gains in basic academic 
skills, as measured by the three CTBS subtests, over the school 
year. 

4. Summary - 

Hypothesis #6 was rejected; Charleston High School students 
in their own program did not show increased mastery' in basic 
academic skills. 
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.Table 13 

... _^xr,eJLaJbed__t_rte s t.s_on^^/BQS±^^TB.S_c cores-o f _ 16 K1 Si mdent s 





Reading 
Comprehension 
(45 items) 


Arithmetic 
Cor ^epts 
(3u items) 


Arithmetic 
Applications 
(20 items) 




.range 


19-44 


5-28 


4-20 


Pretest 


mean 


32.00 


18.63 


11.69 




s.d. 


7.01 


5.25 


3.68 




range 


10-44 


10-26 


6-19 


Posttes t 


mean 


29.44 


13.13 


12.31 




s.d. 


9.27 


5.35 


3.83 




t>test * 


-1.42. 


-0.45 


+0.77 




r 


.64 


.65 


. 63 



*t -90 (15) +1.34 
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G. Hypothesis #7 

The ^sev enth hypothes is wa s th at ejc^eri raental _ students (K] ) w i ] T _ _■ . 
acquire increased (p<-.10) mastery in career knowledge. 

1 . Data Source 
The data used to evaluate this hypothesis were the Kl 

students' pretest and posttesc mean scores on the Competence" Test 
of the Career Maturity ' Inventory (CMI). The five subtests of the 
CMi Competence- Test were 1) Knowing yourself , 2) , Knowing^. About... 
Jobs, 3) Choosing A Job, 4) Looking Ahead/ and S) What Should 
They Do. Kl students were administered the CMI in September/ 
1974 and May, 1975. 

2. Procedure 

The pretest and'posttest mean scores of Kl students on the 
five subtests of the CMI Competence- Test were examined. Correlated 
t-tests (directional) were performed to determine whether Kl stu- 
dents had acquired increased (p 4> .10) mastery in career knowledge 
during the 1974-75 school year. 

3. Findings 

. Table 14 (columns 2 through 6) presents the means and standard 

deviations for each of the five competency subtests and the results 
of the correlated t-tests (directional) on pretest/posttest CMI 
Competence Test scores. Kl students . showed no significant (p < .10) 
gains in career knowledge, as measured by the five CMI Competence 
subtests/ over the school year., . 
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Table 14 



Correlated t-tests on Pre/Post CHI Scores of }8 ki . Students 



• 




Attitude 
Scale 
(50 items) 


Knowing 
Yourself 
(?0 items) 


Knowing 
About Jobs 
(20 items) 


Qswsir-g 

■ • A, 

\ *■ J ., V !■ »%> J 


Looking 
Ahead 
(20 items) 


What Should 
They Do , 
(20 items) 




range 


30-42 


4-18 


4*20 




10-20 




Pretest 


mean 


,35.39 


13.39 


15.39 


+ ,* f 


14.39 


11.83 




s.d. 


3.20 


3.81 


_ 3,84 -. 


JS,tf>. 


2.69 ■ ., 


- - 2.16 • ■ 




range 


29-46 


4-18 


10-20 


6-19 


8-18 


6-17 


Posttest 


mean 


37.83 


• 14.00 


16.06 


13.61. 


13.61 


11.11 




s.d, 


4.59 


4.12 


2.97 


3.39 


3.01 


2.93 




t-test* 


2.26* 


0.95 


0.99 


o.v 


-1.11 


-0.99 




r 


.35 


•77 , 


.67 


.70 


■ .46 


' .30 



*t (17) * 1.33 
.90 
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4. Summary 

Hypothesis #7 was rejected; Charleston High School students 
enrolled in their own EBCE program did not show increased mastery 
in career knowledge* 



6 •) 
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H. Hypothesis #8 

The eighth hypothesis was i that experimental students (Kl) will 
acquire increased (p < .10) career maturity. 

1. Data Source 

The data used to test this- hypothesis were the Kl students 1 
pretest and posttest mean scores "on the Attitude Scale of' the v 
Career Maturity Inventory (CMI) . Kl students were administered 
the CHI- in September, 1974 and May f 1975. 

2. Procedure 

The pretest and posttest mean scores of Kl students on 
the CMI Attitude Scale were examined. Correlated t-tests 
(directional) were performed to determine whether Kl students 
had acquired increased ( p < .10) career maturity during the 
1974-75 school year. 

3. Findings 

Table 14 (column 1) presents the means and standard devia- 
tions for the pretest/posttest .CMI Attitude Scale scores and the 
results of the correlated t-test (directional) . Kl students 
, showed significant growth ( p < .ID) in career maturity over the 
school year. 

4. Summary 

.(■ 

Hypothesis #8 was not rejected; Charleston High School stu- 
dents enrolled in their own EBCE program did acquire increased 
career maturity. 



I 
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I. Hypothesis #9 

The ninth hypothesis was that experimental students (Kl) will 
acquire positive attitudes toward their learning environments. 

1 . Data Source 

The data used to evaluate this hypothesis were the posttest 
scores of Kl students on the Assessment of Student Attitudes (ASA) 
ins t rumen t . The ASA has four subtest scores (Attitude towards 
rducation in General, towards School Curriculum, towards School 
Resources, and towards School Counseling) and a composite score 
(Attitude towards the Total Learning Environment) . The ASA was 
administered to Kl students in May, 197 5. 

2. Procedure 

Since the ASA utilizes a Likert-type format for item responses 
with some items possessing reversed polarity, subscale weighted 
points rather than actual response :./■.• ..>s were analyzed. Descrip- 
tive statistics were used to determine whether Kl students acquired 
positive .attitudes tot- ird their L<^; , .< ; environment. 

3. Findings 

Table 15 presents the means and standard deviations for the 
-posttest ASA subtest scores and the composite score. The data 
indicate that the Kl students did possess positive attitudes towards 
the educational aspects addressed in the four subtests of the ASA 
and toward the total learning environment. 

4. Summary 

Hypothesis #9 was not rejected; Charleston High School 
students enrolled in their own program did acquire positive 

62 
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attitudes tow ard va rious aspects of the educ ational system 
and toward the total learning environment. 



Table 15 

Means and Standard Deviations on Posttest ASA Scores 







Kl 


Students 








Education 
in General 
(35 points) 


School 
Curriculum 
(25 points) 


School 
Resources 
(45 points) 


School 
Counseling- - 
(25 points) 


Learning 
-Environment 
(130 points) 


range 


19-34 


10-25 


16-44 


11-25 


71-122 


mean 


27. Q8 


j 19.88 


32.83 


18.17 


97.96 


s .d. 


4.16 


3.30 


6.96 


5.99 


15.20 


n 


24 


24 


24 


24 


24 



\ 



6 3 
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J. Hypothesis #10 

The tenth hypothesis was that parents off EBCE students will have 
positive attitudes toward the EBCE program. 

1. Data Source 

The data used to test this hypothesis were from the results of 
a Parent Opinion Survey (See Appendix which was mailed out to 
21 parents in May , 1975. Responses from 19 parents were received 
and tabulated. 

2. Findings 

Most parents who, responded were very positive towards all aspects 
of the EBCE program. All" parents were enthusiastic about: the amount 
of opportunity the career education program provided their sons and 
daughters for learning about occupations. . Fourteen parents (74%) 
felt that EBCE offered their children more opportunity for general" , 
learning; . all but one parent rated the approaches to learning used 
in the EBCE program as very good or excellent. Almost all parent 
respondents (95*>) thought that their son or daughter liked the career 
education program much better than past school experiences and indi- 
cated that they would allow their child to participate in EBCE if 
they had this choice to make again. s 

Parents felt that the greatest strengths of the EBCE program 
were the on-the-job experiences of students (n=8) , the help students 
were given in making career choices (n=5) and the individual: atten- 
tion students received from resource, persons ,and EBCE staff members 

"T'ri'^5"5". FiVe'- parem the* '■que'ST.tOnn'ffiW State"a"-that""- ~ 

they felt the EBCE program had no weaknesses, and one elected to 
make no comment on this subject; the remaining 13 parents mentioned 
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a total of 18 different weaknesses. Most weaknesses were mentioned 
only once or twJ.ce. Program weaknesses most frequently mentioned 
were insufficient communication between EBCE and the students 1 home 
high schools, lack of sufficient suitable job sites, and an atmos- 
phere that was too permissive . 

Sixteen of the 19 parents surveyed thought that the Experience- 
Based Career Education program had had a good effect on helping their 
children in the formation of career plans. Fifteen parents (79%) also 
thought that their sons and daughters were much more motivated to 
learn in the EBCE program than they were in traditional schools. All 
parents rated the approaches to learning utilized in the EBCE program 
as good or excellent. 

Parents also mentioned that they had noticed positive changes in 
their sons or daughters that might be attributable to participation 
in the EBCE program. (See Table 16 ) 

Only two parents mentioned that they had noted any negative 
changes in their children that might have resulted from participation 
in the EBCE program. In both of these cases, the parents believed 
that their children had become "too independent . 11 However, this 
change might not be negative, since some parents find moves to inde- 

0 

pendence on the part of their children threatening, even when the 
child's needs are being served in this way. 

Twelve of the 19 parents (63%) believed that their son cfr daughter 
talked with them, "almost daily" about "what's" going on in the career , 

'"educatiori prbgra^ they had had~f requcnt-or - 

very frequent contact with EBCE staff members. Eleven of the 19 
respondents (58%) had attended at least one meeting during the school 
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Table 16 



Positive Attitude Changes Attributable to EBCE 



Characteristic Mentions Percent 



~udent 


oecame more mature. 


5 


17 


Srudent 


enjoyed school more 


4 


14 


Student 


saw need for additional education 


4 


14 


Student 


made a career decision 


3 


10 


Student 


1 s grades have improved 


2 


7 


Student 


made friends more easily 


2 


7 


Student 


became more independent 


2 


7 


Student 1 


1 s attitude has improved 


2 


7 


Student 


has^ developed more interests 


1 


3 


Student 


makes decisions more easily 


1 


3 


Student 


became happier 




3 


Student 


became more responsible 


1 


3 


Student 


became more punctual 


_L 


3 




Totals 


29 


98%* 



*Due to rounding error, total is less than 100% 
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year where other parents of EBCE students were present* Most. parents 
(58t; n=ll) were definitely sure that they h ad r ece Ived enough in for- 
mation about their children's progress in the EBCE program. 

Almost all parents contacted (89%) rated the general quality 
of the Experience-Eased Career Education program staff as very good 
or excellent. Fourteen (74%) rated their overall relationship with 
members of the EBCE staff as very good or excellent. (All but one 
of the remainder of the respondent group thought that it was satis- ' 
factory.) The enthusiasm of the. EBCE staff was rated as very good 
or excellent, by 17- parents (89%) . All parents but one rated the 
approaches to learning .used in the EBCE program as good to excellent. 

■ The majority of the parents (63%) indicated confidence in the 
occupational plans of their sons or daughters, where such plans 
existed? however, five of the parents (26%} stated that "their son 
or daughter had nude no firm occupational plans at the time of the 
survey. Six parents 1 32%) believed that their son or daughter would 
be attending college jne year after graduating from high school;" 
uhe same number thought their child would be working at this time. 

The remainder of the parents 637%) thought that one year after 

* t. 't * 

leaving high school their son or daughter would be going .to a busip 

^» 

ness or trade school (21%) , would be in the military (5%) , or ^seemed 
unsure of what their child would be doing one year hence Jll%) , 

Parents -believed that the EBCE program had enabled their children 
to learn -a number of things which they (parents) felt were highly - 

impor tant'*:' " Irf Table " 17 ■ parents •"rated the ,,, c±>i;lity-"*to-work- wi*th 

others as the most important type of learning and further indicated 
that EBCE was highly effective in fostering this learning. 



Table 17 



Frequencies of Parents' Ratings of Types of Learnings Fostered By EBCE 



type or Learning : 


Not Highly 
Important Importance Important 
1 2 3 4 5 


Not Highly 
Effective Effectiveness Effective 
1 2 3 4 5 


a. Jrerconn specinc 
occupational skills 


0 0 - 4 4 11 


0. 0 3 6 10 


fa. Be punctual and organize 
their time 


0 0 0 3 16 


, _ , , , 

0 0 2 12 5 


c. Assume responsibility 
for themselves 


■ 0 0 ■ 0 3 16 


1 0 2 3 13 


d. Make decisions and 
follow through 


0 0 ' 1 3 15 


0 0 3-7 9 


e. Communicate with' others 
in a mature way 


0 0 ■ ■ 0 5 14 


0 0 0 6 13 


f . Be aware of more career 
opportunities 


0 0 0 4 15 


0 . 0 2 3 14 


g. Work with others 


0 '0 0 '' 2 17 


0 .0 1 4 . 14 


h v Evaluate their own 
work 


1 . - 0 0 7.' 11 


' 0 0 2 B' 9 


i. Perform basic 
academic skills 


■ 0 0 4 5' 10 


0 .0 *> 7 10 


*i Think Mfminh anH 

solve problems 


0 0 0 4 15 


'00199 


k. Have a positive 
attitude toward self 


0 0 0 4 15 


.0 ' 0 1 6 12 


L Have a positive 
attitude toward work 


0 -0. 1.3 15 


0 : 0 3 7 9 


m. Have a positive attitude 
toward learning 


0 0 3 1 . 15 


0 0 ' 3 6 10 


n. Prepare for further - 
, ..education 


0 2 1 3 13 


0 0 4' 5 10 


o.' Improve interpersonal 
and social skills 


0 0 1 8 ■ 10 


.0 0 3 8 8. 



Parents were also asked about where they had first heard about 
EBCE. Sources of initial information about EBCE most frequently 
mentioned by parents were the home high school (eight mentions) , 



their own children (four mentions) , friends 


of their ch 


ildren 


(four 


mentions) , and letters (two mentions) . 








When parents were asked which kinds of 


students did 


they 


think 


would benefit most from a career education, 


there seemed 


to bo 


little 


consensus of opinion among the 17 parents who responded 


to the 


item. 


Table 18 categorizes and displays parents' 


replies to this question . 


Table 18 








Kinds of Students Who Benefit Most From EBCE 






Type 


Mentions 


Percent 


"Turned of f "/unmotivated students 


5 




20 


Students who are unsure about future plans 


4 




fe • 


Students who aren't going to college 


3 




12 


Mature students 


3 




12 


Disadvantaged students 


2 




8 


Students with special needs 


2 




8 


Any/all students 


2 




8 


Adventurous s tudents 


1 




4 . 


Students who need individualization 


1. 




4 


Don't know 


2 




8 


Totals 


25 




100% 



7 0 
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3 , Summary c 

Hypothesis #10 was not rejected; parents of EBCE students did 
have positive attitudes toward the EBCE program. 



i i 
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K. Hypothesis #11 

The eleventh hypothesis was that experience site, resource persons 
and contact persons ^hereafter designated as "employer") at various " 
levels of their organization will have positive attitudes toward the 
EBCE program. 

1. Data Source " 

The data used to test this hypothesis were gathered from' the 
Employer Interview Instrument which was administered to employers 
by AEL/EBCE staff in May and June of 1975. 

2. Procedures 

An instrument was developed (See Appendix G ) in order to collect 
data for the purposes of this study. Thirty-six (36) experience 
sites were randomly selected to be surveyed from a list of 80 active 
experience sites for the FV'75 school year. [The employer at each 
experience site, was contacted by telephone, .and at this time an. 
appointment was made for a face-to-face -interview at a later date. 
Thirty-one experience site personnel were reached and interviewed. 

A standardized data collection procedure was followed during 
each interview to insure similar exposure of each interviewer to 
the interview instrument. At the beginning" of each interview, the 
interviewer reviewed the reasons for the study. All" information 
which related to the standard questions was recorded, along with any 
' additional comments or suggestions made by employers which the 
interviewer felt to be of importance. 

3. Findings 

Most employers were very receptive. They complimented EECE 
strengths and offered suggestions for program improvement. Eighty-four 

' >. .72 
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percent (n=26) of the employers rated the EBCE program as being 
moderately .effective to very effective, and 84% (n*26) believed that 
their organization would continue to participate in the Experience- 
Based Career Education program in coming years. (Four of the 
remaining five employers were unsure of their organization's con- 
tinued participation in the EBCE program.) 

Twenty-two of the 31 employers (71%) felt that the EBCE staff 

s 

had provided them with the necessary information to direct students' 
activities. Twenty-five employers (81%) believed the EBCE program 
functioned as they had been initially led to believe. 

Eighty-seven percent of the employers (n=27) believed that the 
EBCE students who had been placed with them. were interested in their 
organization. Employers indicated that students placed at their 
sites frequently spent time in actively performing site activities, 
talking with experience site personnel., and observing site activities* 

Experience site" personnel often rendered various supportive 
services to EBCE students. The following services were frequently 
rendered to students by employers: (1) supervision of students in 
the performance .of > job-related tasks (n-25) ; (2) talking abo,ut 
activities at the job site, (n=22^ ; (3) talking about job opportunities 
(n=18) ; (4) helping plan students' assignments (n=18) ; and -(5) evalu- 
ating individual student's assignments (n=12) . (For a more detailed 
breakdown of services rendered by employers to EBCE students, see 
Table 19.) The employers mentioned an average of 5.4 services that they 
rendered to students . 

Most employers (87%; n=27) believed that the greatest strengths 
of the EBCE program were in the area of career planning. and decision- 



Table 19 

■ Supportive Services Provided by, Employers -to EBCE Students 

' No 

Service Provided ^ _ Frequently Occasionally Seldom Never Answer 



✓ 

buperviSxon or students in- job-related tasks 


25 


1 


1 


1 


3' 


laiKing aootit ]od site activities 


22 


4 ' ' 


0 


2 


3 


.lduuiKj gduul jod opportunities 


18 


9 ■ 


■ 0 


1 


3 


Helping p^an students assignments 


18 


4 




6 


3 


Evaluating individual students' assignments 


12 


5, 


;3 


■8 


.3 


Talking about students' personal problems 


2 


10 ■ 


7 


9 


3 


Tutoring in an academic area 1 


2 


• -7 


4 


• 15 


3 


Assisting students in non-job-related assignments 


, ' 1 . 


& ■ 


7 


13 


4 


Other 


3 


4 . 


0 ■ 


0 


24 
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making. They felt EBCE was an important means of exposing students 
to the world of work, enabling them to explore different careers and 
aiding them in career decision-making. 

Almost all employers reported favorable reactions toward EBCE 
students from employees and top-level management. Eighty-four percent 
(n=31) of employers 1 comments mentioned favorable reactions toward. 
EBCE students from employees, arid 90% (n-28) of employers' comments 
mentioned favorable reactions toward EBCE students from top-level management 

Fifty-five percent of the respondents (n=17) believed that EBCE 
students 1 presence at their experience site had positive, impact on the ' 
amount of work performed by regular employees; 32% of the employers (n-10) 
believed that EBCE students hgid had positive impact on the quality of 
work performed by regular employees. A positive effect on company 
training practices was noted by 26% (n=8) of employers, and 19% (n=6) 
thought that there was a similar effect on company hiring practices. 
Whore an impact was ' reported , it was almost always positive; however, 
many respondents perceived no impact whatsoever on company policies, 
and practices , (For a more detailed bro^kdown of the answers to this 
question, see Table 20) . 

Several employers su#£&iked that specific changes be made in 
FY' 76 to ameliorate certain program weaknesses . Six employers (19%) 
felt that there should be closer supervision of experience site • 
activities by EBCE staff; five (16%) w^.r.uid the opportunity to decide 
about the timina and/or . length of site placements. Six employers 
(19%) felt that there should be better matching of students and' 



Table 20 

Impact Reported by Employers on Company Policies and Practices 

Amou nt of Impact . Value of Impact 





No 


■ Some 


Much 


Don't Know/ 


Good 


Bad 


Don't Know/ 


Impact Area 


Impact 


Impact 


Impact 


No Answer 


Impact 


Impact 


No Answer 


Quality of employee work 


20 


8 


1 


2 


10 


0 


21 


Amount jf employee work 


9 


19 


1 


2 


17 


3 


11 


Company hiring practices ■ 


21. 


' 6 


0 


■4 


6 


0 


25 


Company training practices 


21 


8 


0 


2 


8 


0 


23 


Other 


0 


16 


3 


16 


15 


3 


17 



60 



experience sites in order to insure successful site placements. 
Another frequently-mentioned weakness, cited five times, was poor 
communication between EBCE staff and experience site personnel. 
4 . 'Summary 

- Hypothesis #11 was not rejected; the .majority of experience 
site resource persons and contact persons at various levels of their 
organizations" had positive attitudes toward the- EBCE • program. 
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L. Hypothesis #12 

The twelfth hypothesis to be tested was that graduates of the EBCE 
program will demonstrate positive attitudes toward learning environ- 
ments (if students) or demonstrate job satisfaction (if employed) . 

1. Data Source and. Procedures 

During May and June of 1975, a follow-up study of the students 
who had graduated from EBCE in 1973 and 1974 was initiated by ... 
AEL and the Educational Testing Service (ETS) . The study was 
conducted jointly by' AEL and ETS staff, and ETS staff was 
responsible for collecting all data. The two groups jointly 
prepared a nine-page 37-item interview schedule (See Appendix H) 
and 111 of the 128 students (86.7%) were located. The final 
sample was made up of 34 students who graduated from the EBCE 
* program in 1972-73 and 77 who graduated in 1973-74 (See Table 21} . 
Those data amenable to such treatment were joded and tabulated^ 
The responses to the short-answer, open-ended questions were 
grouped as seemed most appropriate for each question. The 

responses to both types of questions are summarized in the 

■ 

following paragraphs. 

2. Findings 

The student groups were about equally represented by sex, 
3ut3 40.5% of the group either had been or were presently enrolled 
in some form of post-secondary training as of June, 1975. About 
two-thirds of the graduates live with their parents, and 86.5% 
have remained single/ Almost half of the EBCE graduates are now 
working ll-time, and slightly more than one-third re now full- 

80 



Table 21 , 
Number and Percent of EBCE Graduates * 
Interviewed by Semester and by Sex* \ 





Seniors in 1972-73 




Seniors in 


1973-74 




Total 




Full Year 
No. % 


Spring Sem. 
No. 4 ■ 


Full Year 
No- \ 


Spring Sem.' 
No. % 


No. % 


Male 


13 81.2 


8 . 


44.5 


12 37.5 


22 


48.9 


55 49.5 


Female 


3 18.8 


10 


55.5 


20 e:.5' 


23 


51.1 


56 50.5 


Total 


16 100.0 


18 


100.0 


?2 100.0 


45'' 


100.0 


I'll 100.0 ( 



♦Students enrolled in EBCE during 1972-73 and 1973-74 were either enrolled for a full year 
' (both fall and spring semesters) or for only one semester-, (spring), Tables 21 through 12 



; reflect this enrollment pattern, 
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time students (See Table 22) . 

Of the total sample, 61.3% reported no difficulty with ob- 
taining employment (See Table 23) . Those who did have some difficulty 
(38.7%) either reported that they didn't know the reason for their lack 
of success or that they didn't follow up on specific job applications. 
The most frequent reason for being unable to obtain employment related 
to the poor job market and some former students mentioned that they 
did not have particular qualifications for jobs in which they were 
interested'." 

Of the students who had worked, the most frequent occupational 
class was general labor or community or public service (Set Table 24) . 
Some reported holding secretarial, clerical, or office worker positions . 
Most of the graduates gave "money" as their primary reason for 
obtaining employment, and more than one-fifth of the students indicated 
that they were working' to obtain money to further their education. 
About 15% indicated that they liked to work or that there was no other 
acceptable alternative. The students appeared to be pretty well satisfied 
with their present status and with the course of their careers (See 
Table 25) . They felt that rheir careers were likely to turn out somewhat 
better than the careers of other people their age. (About two- thirds 
of the students indicated that th£y wire much more satisfied with how 

their careers were likely to turn out , than- with how the careers of 

. I s -. 

people their own ages were likely to develop.). v ere more impressed 

with future - s -~eer probabilities than they were wii : . t>~ix present 
status, which indicated desire to' improve their career standing. About 
thr^-fourths of the gracuates indicated a desire to work at a job 



/ 



Table 22 

present Activity of EBCE Graduates* 





Seniors if 


1972-73 




Seniors in 


1973-74 




Total 




Full Year 
No. % 


No. 


I 


. Full Year- 
No. % 


Sprina Sem. 
No. 1 


No. % 


Unemployed- 
Not Looking 


0 




'•0 


0 


2 


6.2 


1 


2.2 


3 2.7 


Unemployed- 
Work 


"5 

o 


12.5 


2 


n i 


5 


15.6 


5 


11.1 


14 1? 6 


Unite cmi fp 


ft 

0 


A 

0 


1 
J 




3 


9.4 


1 


2.2 


7 fi 3 

/ D.J 


Full-Time 


5 


22.7 


D 


J J. J 


6 


lo. / 


22 


48.8 


•5Q "K 1 


rril u Hide 

Student 


2 , 


12.5 


2 


11. 3 


1 


" 3.1 


1 


2.2 


6 5.4 


Part-Time 


2 


12.5 


2 


11.1 


" 9 


23.1 


9 ' ' 


'20.0 


22 19.8 


Working 
Full-Tke 


11 


68.7 


10 


55.5 


11 


34,4 


19 


42.2 


51 ' 45.9 


No. Resp. 


0 


0 


0 


0 


0 


0 


1 


2.2 


1 .9 


Tot. Sample 


16 




18 , • 




32 




45 




111 



9 

ERIC 



♦The sum of numbers in columns may be greater than total sample size and sum of percent • 
in columns may, be greater than 100 because students were; asked to respond to all categories 
that applied. . - r '" : 



Table 23 



Kuaiber and Percent of Graduates Who Tried for and Didn't Get 
Jobs and Their Difficulty in Getting Work 



Tried For 



Seniors in 1972- 12 
Full v ear Spring Seis. 



No . i 



Seniors in 1973-74 
Full Year Sorina Sem, 



So. % 



Total 



!to. 



Yes 



No 



No Resoonse 



Total 



2 12.5 8 44.4 



5 31.2 9 50. 



12 37.5 3 17. 



9 28.1 17 37. 



16 



18 



11 



32 



20 



45 



30 27.0 
40 36.1 
41 
111 



Reported 
Difficulty 

None 

Some 

Much 
No Response 
, Total 



13 81.2 13 72.2 



2 12.5 



16 



3 16.7 



1 6.3 2 11.1 



18 



16 50.0 26 51. [ 



25.0 12 26.7 



7 21.9 



32 



45 



11.1 



68 51.3 
25 22.5 
.15 13.5 
3 

111 



Table 24 



■Kind of Work in Which EBCE Graduates Are or Have Been Engaged 



88 



Area 


Seniors 
Full Year 
No. \ 


in 1972-73 
Spring Sem. 
No. % 


Seniors 
Full Year 
No. % 


in 1973-74 
Spr;r,g Sem. 
No. % 


Total 
No. \ 


Engineering, Physical Science f 
Mathematics, and Agriculture 


♦ 

. ' 0 0 


0 


0 


0 


0 


0 


i 


0 0 


Medical and Biological Sciences, 
Agriculture, Forestry 


U 0 


0 


0 


■ 0 


0 


1 


2.6 


1 1.0 


Business Administration, Accounting 


fi ft 

0 0 


o' 


0 


. 0 


0 


0 


0 


fi fi 

0 ,0 


General Teacning and Social Service 


ft ft 


0 


0 


1 


3.4 


1 


2.6 


fi fi fi 

2 2.0 


Humanities, Law, Social and 
Behavioral Sciences 


0 0 


1 


:6.2 


0 


0 


0 


0 


1 1.0 


Fine Arts, Performing Arts 


1 6.2 


ft 

0 


n 


1 


3.4 


(J 


U 


2 2.0 


Technical Jobs, Computer Applications, 
Communications 


2 12.6 


1 


6.2 


4 


13.9 


0 


0 


7 7.0 


Proprietors, Sales 


1 ' 6.2 


2 


' 12.5 


0 


0 


■4 


10.2 


7 7.0 


Mechanics, -Industrial Trades 


0' 0 


1 


6.2 


3 


10.4 


1 




. 5 5.0 


Construction Trades 


0 0 


0 


,0 


1 


3.4 


1 


2.6 


2 U 


Secretarial-Clerical, Office Workers 


3 18.8' 


5 


31.3 ' 


1 


3.4 


12 


30.7 


21 21.0 


General Labor, Community 5 Public Services 


8 50.0 


r 

o , 


37.6 


17 


58.7 


19 


48.7 


50 50.0 


Military 


■ 1 6.2 


0 


0 ' 


1 


. 3.4 


0 


0 


2 2.0 


Nothing 


0 '0 


0 


0 


0 


0 


0' 


0 


0 0 


TOTAL 


16 100 


16 


100 ■ 


29 


100 


39- 


100 


■100 100 



89 



67 



Table 25 

Number of Students Who Were Se^isf ied/Dissatisf ied 
With Aspects of Pre ":t Job 
1972-73 and 1973-74 Seniors 





Very 


Dissatisfied 


- Very 


Satisfied 


Mean 




1 


2 


3 


4 


5 


NA 


(1-5] 


Earnings 


13 


9 


32 


25 


15 


i 

-L 


3.2 


Duties 


6 


13 


25 


22 


29 


0 


3.6 


Job Security 


* i 


11 


24 


12 


34 


1 


3.5 


rvt; o J^J Olio i~LJ lllLV 


c: 


6 


24 


O "7 


33 


c 


3 . 8 


Promotion 


31 


14 


24 


11 


9 


6 


2.5 


Benefits 


26 


12 


13 


6 


26 


12 


2.9 


Opportunities 


15 


12 


19 


25 


23 


- 1 


3.3 


Getting Along 


3 


2 


10 


25 


52 


3 


4.3 


Supervisor 


10 


5 


12 


22 


43 


2 


3.9 


Work Conditions 


5 


8 


21 


23 


38 


0 


3.8 


Number Responding 














95 




90 



68 



other than the one at which they are currently employed, but this 
response may have been influenced by college and university students 
working at part-time jobs- Students most satisfied with their 
current jobs were those who enrolled d.;-ing the spring semester of I j 1 ^ , 
and this was the group with the highest percent o: student s partici- 
pating in some educational or training program. 

More students aspired to the medical and biological sciences 
(23.4%) than any other major category of occupations, and the second 
most popular occupational category was general teaching and social 
service (15.9%). There was wide dispersion of preferences across all 
categories of occupations. In self -comparisons with persons their 
own a^f, the graduates were pretty well satisfied with .their progress 
to date and were especially well satisfied with their chances for 
success in the future. More than half of die graduates reporting rated- 
the career condition, "getting along with fellow workers", ay "very 
satisfied" in their present job, and they were least satisfied with 
the attribute designated "opportunity for promotion or advancement". 
Social considerations and opportunities for promotion were considered- 
more important to EBCE graduates than were present earnings/ .specific 
job assignments, job s< ^urity, or t sent opportunities to use their 
knowledge and ability, i 

Thirty-seven of the students <75%) participating in educational 
or training programs weLe enrolled in four-year colleges or universities. 
Other training programs/ with two students each included employer trainin* 
programs/ junior colleges / and Armed Services training programs. 
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More graduates continuing th* education were studying, in 
the areas of medical and biological science? , including agriculture 
and forestry, than any other categor*'. That area was followed closely 
by the general teaching ar.u social service category. Almost three- 
fourths of the graduates (72.3%) reported that they were satisfied 
with their educational program (See Table 26). Most of them (69.8%) 
Indicated that their reason for pursuing their educationa 1 program 
was M to pursue a chosen career". No students indicated that "parent 
pressure" was a main reason for choosing an educational program, and 
only one reported that "pressure from friends" was a reason. In an open 
ended question, ten students indicated that pursuit of career 
opportunities was a major reason for participating in educational 
programs, and another ten gave a statement classified as an attempt 
to obtain knowledge. One 1974 spring ^smcster student said, "I 
wanted an education that would serve me and let me gc or and learn." 
Another indicated, "Experience, independence,, getting away from home , 
and fun" in that order. 

VJhen asked about what kinds of subjects or skills they would like 
to learn in the next five years, the most frequent response was again 
classified as medical and bioloc-ical sciences, and the second most 
frequent pertained to general teaching and social service (See Table 27) 
However, the most impressive aspect of the responses was the wide 
variation and precise specification of career areas. For example, 
the listing of subjects or skills included management . finance 
physical therapy, law, business math, dental V ygiene , and forestry. 

/ 

j 

More than one- fourth of the graduates expe: L^d to complete a 
four-year college degree, 17 aspired to a M.A V , and six hop&d to 



Table 26 

Satisfaction With Educational Programs 





Seniors in 


1972-73 




Seniors in 1973-74 




Total 




Till i V/i-, v 

tun year 


Spring Sea. 


full Year 


Spring Sem. 




t 


No. \ 


NO. 




No. % 


No. 




Ko._ J_ 


Satisfied 


5 71.4 


4 


44.5 


7 70.0 


18 


85.7 


34 72.3 


Not 
















Satisfied 


2 28.6 


3 


33.3 


1 10.0 


1 


4.6 


7 ■ 14.9 


Sot Sura 


0 0 


2 


22.2 


2 20.! 


2 


9.5 


& 12.8 




7 100.0 


9 


100.0 


10 100.0 


21 

1 

< 


100.0 


47 1.00.0 



91 

93 
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Table 27 

Subjects or Skills Which EBCE Graduates Wish to Learn About in Next Five Years 





Seniors in 1972-73, 
Full Year Spring Sem. 


Seniors in 1973-74 
Full Year Spring 


Sem. 


Total 


Engineer ing, Physical Science, 
Mathematics, £ Agriculture 


No. 

• 2 


12.5 


No. 

0 


0 


No. 

0 


% 

0 


No. 

0 


X 

0 


No. 

2 


1.9 


Medical 5 Biological Sciences, 
Agriculture, forestry 


2 


12.5 


3 


16.8 


7 


23.4 


16 


jo. J. 


28 


26.4 


Business Administration, Accounting 


4 


25.0 


2 


11.1 ■ 


0 


0 


4 


9.5 


10 


9.4 


GeneTal Teaching and Social Service 


1 '' 


' 6.3 


6 


33.3 


6 


20.0 


U 


26.2 


24 


22.7 


Humanities, Law, Social S' 


1 


6.3 


1 


5.5 


3 


10.0 


3 


7 1 
/•J.- 


8 


7.5 


ZiiiZ nX Lb / rcIlUlUUIiy alio 


2 


12.5 


0 


0 


1 


3.3 


2 


A ft 


'5 


4.8 


cation*, Communications 


2 


12.5 


3 


16.8 


5 


16.7 


0 


0 


10 


9.4 


Proptiecors, Sales 


0 


0 


0 ■ 


0, 


0 


0 


1 


2.4 


1 


.9 


Mechanics, Industrial Trades 


0 


0 


1 


5.5 


4 


13.3 


3 


7.1 


8 


7.5 


Construction Trades 


, 0 


0 


0 


0 


0 


0 


0 


0 


" 0 


0 


Secretarial-Clerical, Office Workers 


1 


6.3 ■ 


1 


5.5 


1 


3.3 


2 


4.8 


5 


'4.8 


General Labor, Community S Public 
Services 


0 


0 


, 0 


0 


1 


3.3 


0 


0 


1 


.9 


Military 


u 


0 


0 


. 0 


0 


0 


0 


0 


■0 .. 


, 0 


Nothing 


' 1 


6.3 


1 


5.5 


2 


6.7 


.0 . 


0 


4 


3.8 


Total . . 


16 




18 




30 




42 




106 





i 



72 



obtain a doctorate (See Table 28) . Students who attended only spring 
semesters during each of the two years tended to have somewhat higher 
educational aspirations than students who attended the full. year. 
This was probably due to a selection bias , since students who had •■ 
completed all formal college requirements tended to have postponed 
entrance into EBCE until the second semester of their senior year. 
When asked how much money they expected to make five years from now, 
the category most frequently responded to was $10,~000 to $14,999 per 
year (See Table 29) . 

The final section of the interview dealt with the graduates 1 
attitude toward their EBCE experience. The aspect they liked most was 
classified as relating to work experience at sites (See Table 30) *. 
Comments included, "Got a chance to judge other working environments , " 
and "I liked the way you could work at a job two weeks or more or less; 
you had a choice of such a- wide variety of careers you could look into." 
Several students expressed a liking for the freedom to pursue career 
interests and others stated some preference for the learning coordinators 
or the administration of the EBCE Program. When asked for dislikes 
concerning the EBCE Program, more students responded positively than 
cirtically. A few of the students had criticisms concerning the 
administration; e.g., "red tape", and a few (4.5%) indicated 
socialization difficulties. 

When asked to rate certain skills, the former students felt they, 
had gained most in "ability to communicate with adults",- and that 
skill area was followed by "learning specific job skills". The area 
in which they felt they . had learned least was math skills. When the 
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Table 28 



Planned Level of Formal Education 



Seniors in 1972-73 Seniors in 1973-74 Total 





Full Year 


Spring 


Jem. 


Full Year 


Spring Sem. 








No. 






4 


No. 


% 


No. 




No 




Don't Know 


4 


25.0 


l 


5.6 


4 


12.5 


4 


8.9 


13 


11.7 


High School 


1 


6.3 


3 


16.6 


3 


9.4 


5 


11.1 


12 


10.8 


Mr. College 


0 


0 


0 


0 


3 


9.4 


1 


2.2 


4 


3.6 


Business Center 


0 


0 


0 


0 '' 


0 


0 


0 


0 


0 


0 


Vocational or 
xecnnicai 


0 


0 


1 
1 


J.O 


4 


12.5 


3 


6.7 . 


a 

0 


7 2 


2-Yr. College 


4 


25.0 


1 


5.6 


2 


6.1 


4 


8.9 


11 


9.9 


4-Yr. College 


3 


18.7 


8 


44.4 


6 


18.8 


16 


35.6 


33 


29.7 


MA 


2 


12.5 


4 


22.2 


7 


21.9 


4 


8.9 


17 


15.3 


Doctor 


• 2 


12.5 


. 0 


0 


0 


0 


4 


8.9 


6 


5.4 


Other 


' 0 

j 


0 


0 


0 


0 


0 


2 


4.4 


2 


1.8 


No Response 


1 0 


0 


0 


0 


3 


9.4 ' 


2 


4.4 


5 


4.6 


Total 


i 16 




18 




32 




45 




111 . 





Table 29 



Expected Annual Income in Five Years 



Seniors in 1972-73 Seniors in 1973-74 

Full Year Spring Sem. Full Year Spring Sem. 

!°i i. 52: _L Ito^ _%_ No. 4 

Less Than $5,000 0 0 0 0 2 6.3 1 2.2 

$5,000-57,499 2 12.6 2 11.1 6 18.8 6 13.3 

$7,500-59,999 1 6.2 2 11.1 5 15.6 6 13.3 

$10,000-$14,999 6 .37.5 4 22.2 9 28.1 11 24.5 

$15,000-$19,999 1 6.2 7 38.9 2 6.2 8 17.8 

More Than $20,000 6 37.5 3 16.7 3 9.4 7 15.6 

No Response 0 0 0 0 5 15.6 6 13.3 

Total 16 18 45 



Table 30 

Aspects of EBCE Program Liked Best 

-- Seniors in 1972-73 Seniors in 1973-7.4 Total 

Full Year Spring Sem. Full Year Spring Sen. 

No. % No. % No. % No. % No. \ 



Freedom to pursue career interests 


4 


25.0 


6 


33.3 


5 


15.6 


,11 


24.4 


26 


23.4 


Work experience at job sites 


7 


43.8 


5 


27.8 


16 


50.0 


11 


24.4 


39 


35.1 


Learning Coordinators or adminis- 
tration of program 


4 


25.0 


3 


16.7 


5 


15.6 


13 


28.9 . 


25 


22.4 


Individualization and self-direction 


1 


6.2 


3 


16.7 


4 


12.5 


7 


15.6 


15 


13.5 


Social aspects (e.g., meeting kids 
from other schools) 


0 


0 


1 


5.5 


2 


6.3 


A 


0 


3 


2.8 


No Response 


0 


0 


0 


0 


0 


0 ' 


3 


6.7 


3 


2.8 


Total 


16 


100.0 


18 


100.0 


32 


100.0 


45 


10C.0 


111 


100.0 



102 



76 



graduates were asked what things they learned in EBCE are most useful 
to them now, the most frequent responses related to the social skills 
area. For example, one student answered, "how to deal with people." 
Another answered "getting along with people — how to communicate with 
people at job sites, and communicating with fellow workers." Almost 
all the former students (93%) gave graduation as their reason for leaving 

EBCE, and none of the 111 former students interviewed reported that they 
"dropped out" or were "asked to leave". 

When asked if their time spent in EBCE had had a positive, negative, 
or no effect on their preparation for further education or jobs, a wide 
majority (more than 80%) cf the graduates indicated a positive response 
for both categories (See Table 31) . However, their first jobs after 
graduating from EBCE did not closely relate to their EBCE experience. 
Almost two-thirds of the students indicated that they were employed 
in a completely different occupation (See lable 32) . 

When asked if there were anything more that they would have liked 
to have received from the EBCE Program to assist them in further 
education or training, the most frequent response related to additional 
career experience. For example, one interviewer recorded "would have 
liked to have had another job site worked out, but she was short of time- 
should have been in the program sooner." 
3 . Summary 

Hypothesis #12 was not rejected; former students do have positive 
attitudes toward learning environments or demonstrated job satisfaction. 
The EBCE graduates from the past two years have selected a wide range 
of careers and training programs. They feel that they are progressing 
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Table 31 

Type of Effect EBCE Had on Preparation for Further 
Education and Preparation-^or Gobs 



Preparation for Further Education 
Seniors in 1972-73 Seniors in 1973-74 



Total 



Full Year Spring Sem, F ull Year Spring Sem. 

No . % No . % No . % No . " % No . % 



Positive 
No Effect 
Negative 
No Response 
Total 
■ V* 



15 
1 
0 
0 

16 



93.8 14 
6.2 4 
0 0 
0 
18 



77.7 24 
22.3 5 
0 3 
0 
32 



75.0 36 
15.6 7 
9.4 0 
2 
43 



83.7 89 81.7 
16.3 17 15.6 
0 3 2.7 

2 

109 



Preparation for Jobs 

Seniors in 1972-73 Seniors in 1973-74 

Full Year Spring Sem. Full Year . Spring Sem. 



Total 



Positive 
No Effect 
Negative 
No Response 
Total 



No. 
14 
1 

' 1 
0 
16 



% No. 



% No. 



% No. 



% No. 



% 



87.6 15 
6.2 2 
6.2 0 
0 
18 



83.3 27 84.4 37 
16.7 3 9.4 5 



2 
0 
32 



6.2 



1 
2 
43 



86.1 93 85.3 
11.6 12 11.1 
2.3 4 3.6 

2 

109 
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Table 32 

How Closely First Job After Graduating 
Related.. touJIBCS Experience 



Seniors in 1972*73 



Seniors in 1973-74 



Total 



Full Year Spring Sem. Full Year Spring Sem. 

No. % No* % No. % No. % No. 



Employed in 

Occupation 4 

Related 

Occupation 5 

Different 7 

No Response 0 

Total 16 



25.0 1 

31.2 8 
43.8 7 
2 
16 



6.2 2 

50.0 5 
43.8 24 

1 
31 



6.4 8 

16.1 7 
77.4 24 
6 

39 



20.5 15 14.7 

17.9 26 25.5 
61.5 62 60,7 

9 

102 



1 ftli 



at a rate somewhat better than persons- their own age, and are 
quite positive, concerning their EBCE experience- Although they 
have not held jobs, identical to those visited during their EBCE 
experience, former EBCE students did indicate 'hat the EBCE 
program had a"'positive effect on thei:;: prennrr -ion" for jobs. 
They f£el that their ability to communicate and to get along with 
people are the most valuable , skills they gained from participation 
in the EBCE Program.. They suggest expanding the number and 
variety of. experience sites , as they regard that as the most 
valuable aspect of EBCE. 
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Formative Evaluation 
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A major component of EBCE evaluation (called formative evaluation ) . 
involved the assessment of program components to insure that every com- 
ponent worked. as well as possible, both in isolation and as it meshed 
with other components. It was a process which sought information to. 
answer the questions: Is it necessary? How good is it? How can it be 
improved? 

Results . ^mati', o evaluation of the AEL/EBCfi Program were designed 
to have an impact on the audiences served (pro ject director , program 
developers, and operational managers), timelines, of information, and ' 
program decision-making. . Formative evaluation focused its attention . 
-^on three major areas: the AEl/EBCE proj ect , the Kanawha County School 
System (KCSS) EBCE project, and a comparison of the 1 two projects. 

A set of formative evaluation questions relating »o the uniqueness 
of each project and the common alities of boi±i. proj eczs /ere delineated. * 
Procedures were established to provide data relating 1 . ach question. 
This section -z.. the report presents each question and * - the -major 
results rela to the evaluative investigation of eac' particular question..-. 

Formative Questions 

The first seven questions are related to the EBCE delivery system, 
and the next two questions are related to the impact of the program on 
students. Th° next four questions are related to imp lesnen tation and 
student i erru:i t relent/orientation , -rid the last four questions are related 
to experience ^tes in the community. 

Questio 1 . Do learning coordinators (LC) have all . the. information 
needed to complete., a student's folder? . 

Answer 1 . Almost every item specified on a Student Folder Checklist 

. * 1 0 9 
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was included in students 1 folders .at AEL and KCSS. It appeared that* 
learning coordinators 1 student folders were for the most part, quite 
complete. Even where items were missing, e.g., transcripts, there 
appeared to be' a good reason for their absence - lack of need for these 
data except on a periodic basis. 

Items which were most frequently missing from student folders were 
Career Guides, Studen Evaluation Forms, and Site Visit Reports . It 

v. ■ 

i;s possible that these missing data were of limited value to. the LCs , 

\ . ■ . ■ 

because'v'they often obtain oral .feedback from students and employers; 
however, the items may be of substantial value to evaluators and EBCE 
replicators . 

It shou- . -iLso he noted that there was no consensus as' to what 
"must" be in 3 -Scudent Folder. The checklist generated by the Evaluation 
Unit was an atteirnzr to standardize the investigation procedure. -In one 
check of a ssun~le oi r folders, there were four items which were found 
in all folders t ir the items were not listed on the checklist:. Hence, 
the investig.' documented what was contained in the student folders, 

-rather than at\ -7u< ing to judge whether or not the folders were complete. 
Question low many "students^ leave tns 2BCE program ..durinq the 

school year (ex ar o return to high schools err to drop out ' of scchool) 

and why do the.-, > students' leave? 

Answer 2 . A cr^eck of student records at AEL indicated that 10 of 84 

.students left EBCE -cring the school year. Five of. these 10 students . • 
were enrolled, ir H3 ; .U. for about .one week . (basically during student 
orientation) an-., f : " r e were, enrolled one complete semester. Of the five 
students enrol lort "ibout one week, two had° transportation problems, one 
had money pror ier.s . one left to get married, and the other felt that there 
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was not enough structure or in-depth courses. Of the five students 
enrolled one complete semester, two wanted to be with their original 
peer group, one had transportation problems, one wanted advanced courses 
and one got married. 

A. check of student/ records' at KCSS indicated that 13 students left 
EBCE during the school year. Five students left EBCE after five weeks 
or iess, one left after two months, one left after three months, three 
left after one semester, and' three left after about six months.- Of- the 
five students who departed very quickly, two wanted to return to their 
classes, one had a money . problem, one didn't like going to job sites, 
and one just quit coming to school. The . two-month enrollee had a health 
problem, and the - three-month enrollee wouldn't go to experience Sites. 
Of the three students enrolled one semester, one left EBCE for health 
reasons, one "wanted a college preparatory curriculum, and one had a 
money problem. Of the three students enrolled about six months, two 
had a health problem, and one simply quit school. 

Question 3 . Are' students satisfied that their needs and interests 
are accurately reflected in their experience site placements? — ' 

Answer 3 . Utilizing the Student Perceptions of Experience Site 
formative evaluation . questionnaire , it was found that at AEL'the great 
majority (83%) of students returning questionnaires indicated that the 
experience sites where they had just completed placements were ones that 
they had previously selected on Experience Site Selection forms. While 
placed at experience sites; many responding students (49%) stated that 
they "participated (in activities) a great deal," and 28% thought that-' 
they had "observed and participated about equally." (Thirteen percent 
indicated that they had "observed mostly" but very few (2%) indicated 
that they had "loafed mostly." t 
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Most students (62%) estimated that their resource p.ersons spent 
51-100% of their time with them. (Forty-four percent of student respon- 
dents estimated that their resource persons spent at least 76% of their .- 
time with them.) The most common overall impression student respondents 
had concerning their resource persons was "liked very much" (69%) and 
"liked some" (2C%).. Only fqur>percent of all student • respondc : 
cated any dislike for their resource person. Student respondents most 
frequently described their experience site resource persons as "very 
helpful" (66%), "always available" : (48%) , or " frequently available" 
(27%) , "vexy warm" (37%) or "warm" (38%), "very interested in me" (32%) 
or "much interested in me" (25%) , and.. "very excited about his / her work" 
(32%) or "somewhat excited about his / her work" (42%).. 

Comments made about experience sites tended to be of a general 
nature and positive in content. Of a total of 144 comments made by stu- 
dents, 121 were positive, 21" were negative, and two were mixed or neutral 
in content. The two . comments most: frequently mentioned related to a* 
positive feeling' about their site placements (42 mentions) or resource, 
.persons (40' mentions) . 

Question 4 . What is the ; . comparability in processes between AEL/EBCE 
learning coordinators and KCSS learning coordinators in te^ms of duty 
performance? . - 

Answer 4 . At 'both AEL and KCSS , learning coordinators appeared ' to 
be developing and evaluating ^student Activity Sheets when not engaged in 
sirr±~ visiting. They seem to have a good relationship with their students 
whrrrh is rather informal, and r they ame fairly' tolerant of. the high num- 
ber- of interruptions of their activities which occur.' . Many interactions 
occur between students and their learning coordinators, as they are in 
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close proximity. Students seem to feel free to interrupt their learning 
coordinator when necessary. 

When. a student goes to another part of the building at KCSS/EBCE, 
he/she must check out with his/her learning coordinator- *-»ho fill 
out the appropriate form each time this occurs. Several school 
activities (i.e., signing up of teachers for faculty baseball team, 
picture-taking for Board of Education film, selling candy and 
announcements) often interrupt the flow of activities.. This is- not the 
situation at AEL. . 

At KCSS/EBCE no scheduled ;Hppointments were noted, while at AEL/ . 
EBCE students were scheduled for appointments with their LCs. At AEL 1 s 
EBCE students tend to meet wirh their LCs for 15-45 minutes at the. 
beginning of the school day, while at KCSS/EBCE students usually meet 
with their LCs more frequently bir~ for briefer periods on an "as- 
needed" basis. 

The data gathered on the comparability of processes indicate that 
the students at KCSS/EBCE' and "AEL/EBCE projects exhibit similar 
behavior patterns during school. However, the ' following dif ferences 
in the two EBCE programs may be noted; 

a) Students tend to arrive earlier and stay later at KCSS/EBCE 
than at AEX./EBCE. f 

b) AEL/EBCE students frequently engage in group activities , 
whereas ±r. the KCSS/EBCE program, there are fewer interactions 
among students . 

c) Some KCSS./EBCE students attend .formal , structured classes; while 

most AEL/EBCE student:, d: not. * 
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d) The "in-house" days at KCSS/EBCE are more academically 

- oriented, while "in-house" H*v/s at AEL/EBCE ten fro bo nv.re 
socially oriented. 
- Question 5. What are the criteria for assigning actual credit 
value to student products? 

Answer 5 . Creidt and grading procedures used by the learning coor* 
dinators . appeared to incorporate the guidelines presented in the Basic 
Procedures Manual, but seem to be much more dexailed. 'However/ three 
of the four criteria most often cited by LCs in determining the. value 
of an activity (i.e., quality of a product, time and effort involved 
in completion, work: handed in 'on. time 1 vs.. 'late 1 , and student's 
ability level) are somewhat subjective in nature. Nevertheless, it 
seems that they should all be taken into consideration in the grading 
process. 

Question 6 . What AEL/EBCE Program components, if any, did Kanawha 
County School System find necessary to add/delete/revise? 

Answer 6 .. In preparing a Student Activity Sheet, KCSS learning 
coordinators found Program Area Descriptors to he of most help- to them. 
However, neither of the learning coordinators found any of the sources 
very helpful. The guide to- in-hpuse materials found in .the Cross 
Reference. Catalog (CRC) was felt to be least helpful; both learning 
coordinators found them not helpful at all. Learning Suides., Core 
(Standard) Activity Sheets, and the CRC were also believed to be of 
little or no help. 

Both learning coordinator's indicated that occasionally it was 
difficult to locate information needed to plan student activities. They 
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indicated the following as reasons for this condition existing: 

a) Often the' CRC was inaccuVate or incomplete;. 
■ b) Not enough copies, of some source materials were available; and 

c) Persons ordering core material were riot familiar enough with 
the subject matter to order..... 

One learning coordinator felt that various procedures and duties 
were adequately documented in the Need, Ratiqnale, Procedures (NRPs) 
Manual; the other one, indicated "chat the NRPs has much too .much on some 
things and not 2nough on others. The LC also indicated that more accur- 
acy, better organization, correct grammar, and more sophistication in 
writing were needed modifications. 

One learning coordinator indicated that all information sources 
should be updated and checked for accuracy, spelling, grammar, organi-. 
zation, etc. The other learning coordinator felt that the CRC should 
be revised to correct errors and° include appropriate materials. She 
felt some core materials needed to be expanded to include more variety 
of ability. levels and new and- updated materials. She also felt that 
"no text" items should be eliminated from the CRC. 

In summary, KCSS/EBCE has not changed or deleted program components 
They have added resource materials above and beyond core materials in 
an effort to personalize resources and meet the students' abilities. 

Question 7. What personnel, different from AEL/EBCE, does a school 
system require for program operation? 

Answer 7. The Director of the KCSS/EBCE Program and the learning" ~ 
coordinators were queried throughout the year about personnel needs 
required for successful program operation. Their comments indicated 

xio 
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that a school system ideally needed a county coordinator (assuming more 
than one school was involved) , back-up learning coordinators as substitutes 
during occurrences of illness, accidents, etc., and a full-time community 
liaison person to interact with site personnel and help in the develop- 
ment and analysis of experience sites. 

Question 8 . What are student perceptions of experience sites? 
Answer 8 . Most of the KCSS/EBCE students surveyed seemed satisfied 
with the.EBCE Program and with their experience site placements, although 
the majority of them also perceived that there was need for improvements. 
Most students had positive or neutral responses toward all th« site 
placements they, had had, However „ positive responses to a site may be 
a function of: 1). the personality of the resource person; 2) the 
variety of activities available; 3) the opportunity for hands-on experience 
and/or 4) the congruence of a student's interests and aptitudes with 
opportunities for career exploration available at the site. 

The majority of responding AEL/EBCE students (55%) felt that while 
they were at experience' sites they were treated most like employees.. 
(Thirty-four percent indicated that they were treated most like students, 
and .11 percent felt that they were treated most like guests.) Most 
student respondents rated their experience sites. as "excellent" (39%) 
or "above average" (31%), while a total of only 4% rated their experience « 
sites as "poor" and 2%.as, "very poor". 

The data appeared to be quite positive in terms of students 1 per- 
cec±ions of experience sites. While there are instances iof negative 
stua*en± reaction, it must be mentioned that students are enrolled in 
a program which does not function totally in the confines of a 
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traditional school setting. Instead, they associate with people having 
varioxas personality characteristics and employment responsibilities'. 
Perceptions are a function of interpretations, which are related to the . 
environment in which the interactions occurred. Nonetheless, students 1 
perceptions of. experience sites and of resource persons were still very 
positive. \ 

Question 9 . How does the typical day of a KCSS/EBCE student differ' 
from an AEL/feBCE student? 

Answer 9 . The data gathered indicate that .the students at KCSS/ 
EBCE and AEL/EBCE projects exhibit similar behavior patterns during the 
school day. However, the following differences in the two EBCE programs 
may be noted: 

a) Students tend' to arrive earlier and stay later at KCSS/EBCE - 
than at AEL/EBCE. 

b) AEL/EBCE students frequently engage in group activities, 
whereas in the KCSS/EBCE program, there are fewer interactions 

,v among students. ' 

c) Some KCSS/EBCE students attend formal structured classes, while 
most AEL/EBCE students, do not. 

d) "In-house" days at KCSS/EBCE are more academically oriented/ 
while "in-house" days at AEL/EBCE tend, to be more socially 

/ oriented. 

e) At KCSS/EBCE no scheduled appointments with students were noted 
while at AEL/EBCE students were scheduled for appointments with 
their learning coordinators. 

f ) At -AEL/EBCE students tend to meet with their LCs for 15-45 

ii7 ■ - • ; • ; 



minutes at the beginning of the school day, while at KCSS/EBCE 
students usually meet with their LCs more frequently but for 
briefer periods on an "as-needed" basis. 

Question 10 . What are the relative effects of the different methods 
used to acquaint students with EBCE? 

Answer 10. Analysis of recruitment questionnaires strongly indi- 
cated that the objectives of recruitment and orientation were met at 
AEL/EBCE. However, some recruitment methods (e.g.,. ads in media, assem- 
blies, newspaper articles, booths , at schools) seemed to have been rela- . 
tively ineffective as perceived by students. 

The exposure tour taken by AEL/EBCE students was . of some interest 
and seemed to have been of ..value; students indicated that they, would 
have been interested in seeing sites in different occupational fields 
rather than just one site. Students did not seem to have enough information 
regarding the purpose of the Program Outline and the Program Are,a Descriptor, 
but this knowledge may not have been necessary for them to have had ■ >j 
, during -orientation. 

Almost all AEL/EBCE students (52 of 63) believed all of the objectives 
which the staff thought were important for orientation had been 
accomplished. Forty-five thought that there was nothing about orienta-. 
tion' that they would change'; of the 17 who wanted changes, there was 
little agreement regarding what should be changed 1 . 

Students found out about EBCE in a variety of ways, although most 
(40 out of 63) believed that they had found out about the Program from 
only one or two sources. The four most successful means of publicizing-" 
the program were through former EBCE students, through pamphlets dis- 
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tributed at the schools, through letters, and through high school coun- 
selor's. Based on the memory of students recruited for this school year, 
there was- little difference in effectiveness between former students 
and pamphlets or between letters and counselors , although there was some 
difference in ef fectivenass between the leading two recruitment methods 
(friends who were former students and pamphlets) and the next most 
successful (letters and counselors). Most AEL/EBCE students believed 
that the program staff did a good job of describing the EBCE program 
to the public. 

Analysis of data 'collected on KCSS/EBCE orientation indicated 

that* recruitment objectives were met. A number of students and an LC 

i' 

suggested alternative recruitment methods which might be utilized in 
future recruitment efforts. Several students also made suggestions 
regarding changes in orientation, but no particular trend emerged here. 

As at AEL/EBCE, KCSS/EBCE students did not seem to have enough 
information regarding the Program Outline and the Program Area Descriptor, 
but, again, this knowledge may not have been' necessciry for thiem to have 
had during orientation. 

! 

Question 11 . Why do students choose-- to participate in EBCE? 

Answer 11 . At AEL/EBCE over 40% of .the students surveyed stated 
...that they chose to participate in the EBCE program because they wanted 
to learn about jobs, careers, and the world of work in general. About 
25% of the students also mentioned that they chose to participate to 
f, get out of" the traditional school system. Other frequently^ cited rea- 
sons were "help with career decision-making" (15%) and "work jexperiences 
that will help in the future" (6%) . j - 
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Students choosing to participate in the program seemed to' be indi- 
vidualistic, independent persons who were "turned off" by the traditional 
school system but were also interested in learning about the world of 
work in a setting which makes allowances for individual differences and 
provides them with more opportunities to demonstrate responsibilities 
and independence,, 

These results appeared to be duplicated at KCSS/EBCE. Almost 50% 
of the v KCSS/EBCE students surveyed joined the EBCE program to learn " 
about the world of work and/or to obtain help in career decision-making. 
About one-third of the KCSS/EBCE students joined the program because 
they were "turned off" by traditional classroom activities. 

Question 12 , What is the comparability' of attendance between KCSS, 
AEL, and traditional schools? . 

Answer 12 . Total attendance rates in the KCSS/EBCE and AEL/EBCE - 
programs during October through December, 1974 were 'found -to be very " 
similar: 89.8% at. AEL/EBCE and 88.6% at KCSS/EBCE. These rates'were 
highly similar to the 89.9% total attendance rate for all Kanawha County 
high schools in 1973-74. In both EBCE programs, attendance rates were 
at their lowest during December, but the' reason for this is notOcnown, 
The breakdown of AEL/EBCE attendance data by students 1 home high 
school indicated that attendance rates of students from different high 
schools vary greatly between schools and within schools. Students from 
Charleston Catholic High School and South Charleston High School had 
the highest attendance rates for the entire period (95.9% and 94.3% • 
respectively). Differences in attendance rates may be partially due 
to the transportation problems experienced by students who live 



farthest from the EBCE site, since most of these students formerly 
attended schools which were 15-20 miles away. The local text book 
controversy may also have contributed to the differential attendance 
rates • 

Question 13 . What technical assistance does KCSS require from AEL 
in "implementing EBCE? 

Answer 13 . Technical assistance was provided by AEL to KCSS 
throughout the 1974-75 school year. The major portion was at the 
beginning of ;the year and then for specific tasks throughout the year. 
Technical assistance was provided to KCSS in the following areas: 
X) development of recruitment strategies and recruiting students; 2) 
development and/or formation of a goal and evaluation structure; 3) 
administration of evaluation instruments and test interpretation; 4) 
participation occasionally at weekly staff meetings to discuss program 
related items; 5) the obtaining of site placements for students; and 6) 
consultations on program management and operations. 

However,, it was felt by KCSS and AEL personnel that there were 
certain areas in which technical assistance could have been provided 
or provided in greater depth. Technical assistance would have been 
useful in development an^. analysis of -sites and in writing Learning 
Guides. More technical assistance in integrating the two curriculum 
systems (KCSS/CHS and AEL/EBCE) would have been helpful. Finally, addi 
tional technical assistance in test interpretation would have been 
useful. - 

Question 14 . What are - "?r p<*- oris of EBCE students? 

Answer 14 . When t^ ;~Ss persons were questioned , • they 

121 



94 



perceived the KCSS/EBCE and AEL/EBCE students in a very positive manner. 
It appears that the students were performing adequately and resource 
persons were satisfied with the students' behaviors. About 95% of 
the employers 1 ratings of students 1 personal qualities were of a posi- 
tive nat.ure. Students were usually rated highest on friendliness and 
courtesy and lowest on exercising .good judc.ment, reporting to the site on 
time, or working' neatly and accurately. 

Question 15 , How does KCSS handle experience site maintenance? 

Answer 15 . Many of the experience sites utilized by KCSS/EBCE 
were originally developed and analyzed by AEL/EBCE during the preceding 
years. Consequently, when KCSS/EBCE began operation, they initiated 
site placements through AEL/EBCE. AEL/EBCE maintained these experience 
sites through resource person workshops, through telephone contacts, 
and through the Community Advisory Council. 

However^,— KCSS/EBCE-did develop several— experience sites which 
were in^Vclose proximity to Charleston High School where the KCSS/EBCE 
program operated. The Director of the KCSS/EBCE program did all site 
development and analysis, and liaison and site maintenance activities. 

Question 16 . Are there attitudinal differences between those 
experience site personnel involved with AEL versus KCSS? 

Answer 16 . The data indicated that most resource persons sampled 
perceived the AEL/EBCE and KCSS/EBCE students in a very positive manner. 

4 

It appears that the students were performing adequately and resource 
persons were satisfied with the students 1 behaviors. 

Most of the students surveyed seem to be satisfied with the EBCE 
Program and their :e site placements, although the majority of 
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them also perceive that there is rooir. for improvements* Mop*: srtudenns 
had positive cr n« .il respons ard all the site pi&~FMl ~~ s they 

had had. 

Thus, _:t \r, d that there were attitudinal diffV -:enc:es betrwe^en 
those sites ±n\~ with AEL versus XC3S students. It s : -..Id also be 

pointed out tha " .JS/EBCE and AEL/EBCE students utilized '. -he same -.^perience 
sites in many ca= ; . Consequently, ~r:ny employers were i. /erly con- 
cerned about the r,udents 1 origins terms of whether they were AEL 
or KCSS students) , but only about their interest, conduct, and performance 
while at the experience site. 

Question 17 . "What differences occur in experience .site utilization 
between students involved in AEL versus KCSS? 

Answer 17. During the period from September, 1974 through February 
1975, KCSS/E3CE students utilized 38 joint experience sites and all KCSS/ 
EBCE exclusive sites. On the- average, experience sites where^ KCSS/EBCE 
students were placed (exclusives and non-exclusives) were used 2.14 
times, and each site placement averaged 14 . 90 days in length. 

During the same time period, A EL /EBCE students used 79 experience 
sites. Experience sites where' AEL/EBCE students were placed (all non- 
exclusive) Vere used an average of 1.08 times, and each placement aver- 
aged 17.77 days in length. The difference in the extent of site utili- 
zation between the two programs is probably due to the greater number 
of sites developed by AEL/ EBCE ; it is also interesting to note that in 
length of placement both programs proved .to be quite similar. 
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. \ . Summary 

The .Appaliachia Educationa.1 Laboratory's (AEL) Experie: . r^sed 
Career Education (EBCE) Program has been in existence for t-h^e* vears . 
Originally, the proiect was funded by the United States Of f of 
Education (USOE) , later by the National Institute of Education NIE) . 
The directive from USOE was to develop a community-based alre-'jsative: 
career education program for high -school seniors. 

The first year of operation of the AEL/ EBCE Program was devoted 
to the development and trial of key components of the AEL/EBCE model. 
The project began operation with 22 students in the fall and recruited 
2.3-*nore students in January. There were 35 experience sites originally 
participating and another 45 sites were developed and analyzed. 

The second year of operation was devoted to the refinement of all 
system components so that by June, 1974 the program would be stabilised, 
into an integrated/' transportable product. The project started the 
second year with 44 students in the fall and recruited 44 more students 
in January. At that time 80 experience sites were participating. 
During the second year approximately 40 more sites agreed to participate 
giving a total of about 120 experience sites. 

The dhird year of operation of the AEL/EBCE Program was sprint in 
refinement of all sub-systems and materials, in preparation for the 
forthcoming training and implementation cycle of the EBCE program. There 
were 74 students enrolled at the end of the year and 59 of these ware 
graduating- seniors. The number of experience sites was expanded to eaborrrt 
145. Randomly-Selected experimental and control groups were utilized to 
evaluate- the effects of program participation. A. high school in Vac 
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local £anawfca County School > tern also f ielc-testec -zl.. v SBZE 

progri^n curing the 1974—75 sc. -ol ye *r.. 

De3cr:rcic.. of Scudenr Papulations 

""Th-ars.- were five., distil net groups ?<f students which ronrriz:^.:ed to 
the eiralua^rion of the. EBCE program in. *FY r T5. Three of the five groups 
participated in S3CE and two groups were identified as controls . The 
five crroups of students were : 

El: Volunteer studenrs who were randomly assigned tc tl- ■: -\E:l/EBCE 
Pro gran , 

.2: Volunteer students who joined the AEL/EBCE Program ar~der non- 
random conditions. 

?:i: Volunteer stude ni:s who jointed the KCSS/EBCE Program 3.t 
Charleston Higri School under non-random conditions. 

CI: Volunteer students who were randomly assigned to the control 
group and remained in their home high schools. 

C2 : Volunteer students who were initially randomly assigned to 
the AEL/EBCE Program but subsequently elected to r^mai::, in 
"heir home hi schools and volunteered to serve as non- 
randomly s^lo-^ced controls. 

Ey aJL u a : ; i o n_ Design 

rues' onnaires and standard:! zed tests were administered tzo all 

studenrs to establish the effect of t:he AEL/EBCE Program or. academic, 

attituninal, and maturational variables. The Student laf oranation 

'• / 

Questionnaire (SIQ) , an instrument constructed to provide baseline 

der. " cv^ta, ^. v, idmi:,- .[.• ). ed to all groups at zhv beginy u ■, 

the school year. The Comprehensive Tests of Basic Skills (TT3S), 
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a £.:artdarc. z&e: t- at containing reaci comprehension, arithmetic con- 
cer ~s f ann xrirnnstic applicaticrs s'—utests , /as used wirh all five 
crc.upH in pr»~7o-s:t fashron to as= 3 basic academic performance. The , 
Career Matrrr- inventory (CM I) a rtandardired test containing a 
career attxrud: • scale and subtests rrf several areas of career- related 
competencies was .administered as e " "jsttest to groups El, E2, Cl , and 
C2 and as c_ pre*:^st and. pest -es t re 'r roup Kl . Tne Assessment of Student 
Atritudes (iS.^) , ar. .instrument to avsess studenrs' attitudes and opinions 
about their learning- environments, v-:is administered as a postrest to 
all five groups. Parents, employers at experience sites, and former 
students (graduates) were also questioned to assess other impacts and 
efxects of AEL/E3CE Prograrc. involvement. A univariate analyses of 
variance isrri corrre later, t- tests were used to analyze the summative 
evaluation: data, rnd frrrmative evaluation data was analyzed utilizing 
tabulatrrrrs and descrircrive --rrstics . 

S ur^atrrge .Lings 

"7h- .ifflpsEr^ and effect nr the E3CE program on various respondent 
cr : v ■ s , as rier e rmi ne c by re s Vi na a number o f frypo the s e s . Appr op r i a t e 
start is tic- ;r;r~lyses were co: xrrter to rest the main effects associated 
with ea;v± rhesis- 

Striii^jrrr . A compared :-resr rn pretest and posttest CTBS scores 
indicated r^iar El students did not ..show increased mastery in basic 
academic skillls. Analysis of variance performed on CTBS pretest scores 
of aroups FT: and Cl indicated equivalency (neqatinq the M'V- -Ot ~- ; »'<U ./sis 

--.rvav ia< -re tec!" .rvrques^ between tne two groups. Analysis of varience 
r'erfc-rmed cn CTBS Posttest scores of groups El and Cl a-lsc indicated 
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no significant differences. Hence ~~ was ccon eluded that in basic aca- 
demic skills the El studenr. 3 performed as well as the Cl students 
in rraditional high school . 

Analysis at variance f r ::. tare CN*I Competency subtlest scores indi- 
cated traat El students did, nor £c:q\u re significantly greairer mastery 
than Cl students in the career -.i.owlecge areas as measured by the f ivre 
competency subtests. However, analysis of variance of post test CM I 
Attitude Scale scores indi a tec nat the El slcmdents did acquire sicrni£i- 
cantly greater (p < - 02) career -rsturity than, comparable- Cl studenrs 
enrolled in traditional hich scrrools. 

The posttest scores on the ..~3A were alsc treated, by analysis of 
variance to determine if f f er* ^ ::es of attitudes toward learning envir- 
onments e>.j.:~ted jh-^tweer. "he Si and Cl students- Signrficant differences 
(ranging fro-, p <*0001 t P';.0JG7) were found for eaoh of ~he four 
scales of the ASA and for -is-- wonnposite score. ?These Vesiclts rna^cate^ 

that the 11 students '.iad 7mv.fi car r y more positive =r; -titmoas toward 

learning snvixccnserrcs: tha: Cl students, 

A correlated '. ..est ~-7as rerforned on the pretest, and postrtest CTBS 
scores of id student: tc determine if they had acquire.- increased mastery 
in the basic academic skills. T.ne results indicated that Kl students, 
did not show increased mastery in the basic academic sk: J Lr: . 

Correlated t-te-;t:s were also performed or Ui^ r>>xe tes t~ po-^ tr s t Ofg 
At tit^Je ileal* &nc\ Cojnp-eteru'y Te'.;f '•'"'^es :-f Ni st-Vifents *;;o te^mi^e 
it they j :qlVrec increased :ru~stery in career know.; edge r areas and 
if they had acquired increased raresr maturity. The j^esulrs indicated 
that they shewed :io sicnifrcanr jains in career knowledge, as measured 
by the' five C?II Competency subtests, over the school year. However, the 
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Charleston High School students enrolled ir. tdseir own E3CE .program did 
acquire increased (p .10) case-ex maturity.- 

Descriptive statistics were utilized 1:0 determine if Kl students 
had positive attitudes toward their learning '.environment. Analys-as 
of postrest ASA subscale scopes and the coEproite score indicated that 
the Kl students did possess positive attitude.s toward varioms aspects 
of the educational system and toward the total learning environment. 

£ * rents . A questionnaire was mailed our to a sample of parents 
of EP.CE students to assess :rhe_:L attitudes toward the 'EErjE program. 
Most parents were verr 'positive towards all aspects of tdie HHCE program. 
All parents were enthusiast! * about the amourJ: of opptjrxcmitry the career 
education program .provided fo;r l-.3ar.ainc-.. about j c expand. cr=:.. Almost all 
(95%) parents -nought that one; r cbdld lik-ad EBCE much better than past 
school experiences and indiccr -d ohat daev ♦o'uld allow rrs±i- child to 
participate in E3C~E if they had dais c:ooice r.-.. make agaio.. Almost 85% 
of the parents thought that ..; : BCE had hat a good effect on helping their 
children in the fczrmstion of career plans. Parents .also mentioned that 
they 'had noticed positive chs-r^e^j in th^ftir children that might be attri- 
butable to partic"': >'c3 1 . on An the ES'iGE program (e.g., the students became 
mo re mature., -xr; ' ' ■ 1 e ■:• t u de n t s »sn j ? ye d s eho^ 1 m c" : "e ) ^ 

j^o layers - r;."ipl£ of ^iipe: ,-ence site resource persons and con- 

tact persons were interviewed to determine th.eir atrtituoes toward the 
EBCE program. Most ermplqyerr-s were trery .receptive . They coanrdimented 
ESCE strengths and offered suggestions for pr: rsgram improvement. Almost 
84% of the employers rated tine E3CE prcarram s -s being moderately effec- 
tive to very effective, and almost 64% ;.^„i.ev^d that theix company 
would continue to participate in the EBCZ program in the coning years. 
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Eowenver, employers felt that there should be closer supervision of 
experience site activities by the EBCE staff, that there should be a 
better matching of students and experience sites, and that communication 
between, experience site personnel and EBCE staff should be improved. 

Graduates of EBCE . A follow-up study of the students who graduated 
fxom EBCE in 1973 and 1974 was initiated by AEL and the Educational 
Testing Service (ETS) to assess their attitudes toward learning environ- 
ments (if students) or toward job satisfaction (if employed). Of the 
111 students contacted from the total of 128 graduates, 34 graduated 
in 1$ "3 and 77 graduated in 1974. Analysis of the data indicated that 
almosrt half of the EBCE graduates are now working full-time, and slightly 
raore '-than one-third are now full-time students. Of the total sample, 
over £0% reported no difficulty with obtaining employment. The most 
frequent reason for being unable to obtain employment related to the 
poor job market or to the lack of qualifications for jobs in which they 
were interested. Of those participating, in educational or training 
programs, 75% were enrolled in four-year colleges or universities. More' 
graduates continuing their education were studying in the areas of 
medical and biological sciences, including agriculture -and forestry,, 
than any ^ther category. Over 72% of the graduates reported that they 
were . satisfied with their educational program. 

When asked about their attitude towards their EBCE experiences, 
the aspect they liked most related to work experiences at sites. When 
asked if their time spent in EBCE had had a positive, negative, or* no . 
effect on their preparation for further education or jobs, more than 
80% indicated a positive response for both categories. However, their 
first jobs after graduating from EBCE did not closely relate to their 
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EBCE experience. The graduates felt that their ability to communicate 
and to get along with people were the most valuable skills they gained 
from participation in the EBCE program. 

Formative Findings 

The results of formative evaluation of the EBCE program were designed 
to have an impact on various audiences and program decision-making. Forma- 
tive" evaluation focused on the AEL/EBCE Program, the KCSS/EBCE Program, 
and a comparison of the two programs. Results to a set of formative 
evaluation questions were obtained throughout the school year. The ques- 
tions related to the EBCE delivery system, the impact of the program 
on students, implementation and student recruitment/orientation, and 
experience sites within the . community • 

EBCE Delivery System . A check of students' folders indicated that 
learning coordinators did have sufficient information to complete a stu- 
dent's folder. However, items missing from folders usually were of 
limited value to learning coordinators. A check of student records also 
indicated that nearly 50% of the EBCE dropouts occurred during the first 
week or two of school. The principle causes appeared to be related to 
transportation problems, money problems/ or a desire to return to their 
original peer groups. An investigation was conducted of students' degree 
of satisfaction that their needs and interests vesre reflecr.^d in thci.-r 
experience site placements. It was found that over 80% of the students * 
had just completed placements which were previously selected on Experience 
Site Selection forms. 

When comparing' the processes of the AEL/EBCE and KCSS/EBCE leaving 

coordinators in terms of duty performance, it was found that the pro- 
cesses were very similar. The most notable difference was that AEL/EBCE 
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students were scheduled for appointments with their learning coordinators 
while the KCSS/EBCE students met with their learning coordinators on an 
"as needed" basis. Credit and grading procedures within the two EBCE 
programs appeared to incorporate the guidelines presented in the EBCE 
Basic Procedures Manual. Although AEL and KCSS operated the program in 
two different environments, KCSS did not change or delete any program 
components. They did add additional resource materials in an effort to 
personalize resources and meet the students' abilities. While KCSS did 
operate their EBCE program with just a Director of Operations and two 
learning coordinators , their comments indicated that a school system 
ideally needed a county coordinator (assuming more than , one school was 
involved), back-up learning coordinators, and a full-time community 
liaison person to interact with site personnel. ; 

Program Impact on Students . Both AEL/EBCE and KCSS/EBCE students 
perceived their v experience site placements in a positive .manner. Although 
KCSS/EBCE students had no negative responses toward their experience 
site placements, the majority of them indicated that there was need for 
improvements. Most AEL/EBCE students (70%) rated their experience sites 
as "excellent" or "above average." 

Data collected at the AEL/EBCE and KCSS/EBCE sites indicated that 
the students exhibit similar behavior patrerns during the school day. 
However, "in-house" days at KCSS/EBCE are more academically oriented, 
while "in-house" days at AEL/EBCE tend to be more socially oriented. 
AEL/EBCE students frequently engage in group activities, whereas there 
are fewer interactions among KCSS/EBCE students. Some KCSS/EBCE stu- 
dents attend formal structured classes, while m'JSt AEL/E3CE students 
do not. 
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IxnP- ^mentation amd Student: Recruitment/Orientation . Data obtained 
from recrruitment questionnaires indicated that some recrui orient methods 
(e_g. , ads in media, assemblies, booths at school) seemed to be relatively 
ineff ective. The four mc it successful means of publicizing the program 
were through former EBCE ^tudemts, through' pamph lets distributed at the 
schools,, through letters,- and through high school counselors. At AEL/EECE 
over 40% of the students surveyed chose to participate in the EBCE pro- 
gram because they wanted learn about jobs r careers, and the world of 
work in general. Alimos::t 50% of the KCSS/EBCE students surveyed joined 
the EBCE program to leaarn abc - at tfce world of work and/or obtain help 
in career decision-making. Attendance rates in the KCSS/EBCE and AEL/ 
EBCE Procrranns during a three-nnonth interval were found to be very similar: 
89.8% at AEL/EBCE and 6 3.6% at KCSS/EBCE. These rates were highly similar 
to the 89.9% total attendance rate for all Kanawha County high schools 
in 1973-74. The major patrtion of technical assistance provided by AEL/ 
EBCE to KCSS/EBCE was at the beginning of the school year and then for 
specific tasks throughout the year. This technical assistance was 
primarily in terims of recruitment and evaluation. More technical assis- 
tance ira integrating the Charleston High curriculum and the AEL/EBCE 
curriculum would have facilitated implementation. 

Community Experience Sites . Many of the experience sites utilized 
by KCSS/EBCE were originally developed and analyzed by AEL/EBCE, but 
KCSS/EBCE did secure several experience sites which wejre in close proximity 
to Chaxleston High School where the KCSS/EBCE program operated. AEL/EBCE 
maintained the jointly used experience sites and the Director of the 
KCSS/EBCE program maintained those experience sites used only by KCSS/ 
EBCE students. During a six-month period KCSS/EBCE utilized 38 joint 
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experience sites and all KCSS/EBCE exclusive sites - an average of 2.14 
placements per site with an average placement of 14.90 days in length. 
During the same period AEL/EBCE students used 79 experience sites - an 
average of 1.08 placements per site with an average placement of 17.77 
days in length. 

Employers at experience sites perceived the KCSS/EBCE and. AEL/EBCE 
students in a very positive manner. About 95% of the employers' ratings 
of students' personal qualities were of a ^positive nature. Students 
were usually rated highest on friendliness and courtesy and lowest on 
exercising good judgment; reporting to the site on time, or working neatly 
and accurately. It appeared that there were no attitudinal differences 
between those experience sites involved with KCSS/EBCE and AEL/EBCE 
students. Although many AEL/EBCE and KCSS/EBCE students utilized the 
same experience sites', many employers were not concerned about the stu- 
dents' originating high schools, but only about the interest, conduct, < 
and performance exhibited by students while at the experience site. 

Conclusions and Recommendations 

Several conclusions can be reached as a result of the formative 
and summative evaluation activities during FY'75. The conclusions are 
as follows 0 

a) The AEL/EBCE Program was very successful since it did 
successfully serve as an alternative career education 
program. 

h) The AEL/EBCE Program was v demonstrated to be an integrated, 
transportable product since it was successfully implemented 
in a local high school. 
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c) The AEL/EBCE Program was demonstrated to be an enjoyable 
experience since it was positively received by students, 
employers, parents, and former students. 

It is recommended that: 

a) A fol'low-up of graduates- and control group students be done 
during FY'76. It is extremely important to follow these 
groups '.in order to obtain longitudinal data on the impact 
of participation in EBCE. 

b) A study be conducted of the characteristics possessed by and 
skills required of a learning coordinator in order to perform 
successfully in an EBCE program. 

c) A study be conducted which investigates the impact of the 
training of experience site resource persons f as it relates 
to interactions with ^students and resource persons 1 ability 
to implement the EBCE process. . 
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AEL:JES/4-75 



STUDENT INFORMATION QUESTIONNAIRE 



Appalachia Educational Laboratory, Inc. 
Charleston West .Virginia 



The Experience-^ased Career Education (EBCE) Program is in need, of certain 
information in order that a valid interpretation can be made of evaluative data. 
This: questionnaire was designed to obtain some of the needed information.. The 
information which you provide will not be. identified with your name in published 
reports, but will be coded. such that group information can be obtained. Although 
the information requested is highly important for a. valid interpretation, feel 
free to omit any question which is personally -objectionable. 
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NAME. DATE 



1 . Are you : 
D Male . 
O Female 

2. Are you: 
O White 
Q Black 
O Oriental 

I— 1 Spanish Descent (Chicano, Puerto Rica" , etc.) 
I— 1 Native American . . 
D other (specify) 

3. What is your current grade level (as of September, 1974)? 
. Q 10th grade 

CD 11th grade 
Q 12th grade 

4. What is your birth date? 



MONTH 



DAY 



YEAR 



Ill 



What is your father's highest level of formal education completed? 
Q None 

CZ3 Elementary School 

0 Some High School 

1 I High School Graduate 

Fn Some post-secondary (for example, some college, junior college 
business school, trade or technical school) 

if 

n College graduate (four-year degree) 

Seme graduate work 
□ Advanced degree (specify) ■ 



Wriat is your mcttherr's highest level of formal education completed? 
F1 None 

[^1 Elementary School 

FH Some High School 

|~) High School Graduate ■ . 

□ Some post-secondary (for example , , some college, junior college 
business school , trade or technical school) , 

Vl\ College graduate (four-year degree) 

□ Some graduate work 

□ Advanced degree (specify) ' 
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What are your long-range goals? Check only one. 

□ i. CLERICAL such as bank teller, bookkeeper, secretary, typist, 
mail carrier, ticket agent 

CRAFTSMAN such" as baker ,' : automobile mechanic, machinist, painter, 
plumber , telephone installer , carpenter 

CJ 3. FARMER, FARM MANAGER * 

PI 4. HOMEMAKER OR HOUSEWIFE 

PI 5. ^LABORER such as c: nstruction worker, car washer, sanitary worker, 

farm laborer ^ 

PI ONAGER, ADMINlSXFlnTOR such as sales manager, oEfice manager, 

"school . admin i stir atror buyer, restaurant manager, government official 

MILITARY such as career officer, enlisted man or woman in the 
armed forces 

'8. OPERATIVE such as meat cutter'; assembler, machine operator, welder, 
taxicab/bus/ or truck driver, gas station attendant. 

Q 9. PROFESSIONAL such as accountant, artist, clergyman, dentist, physicia 
registered nurse, engineer, lawyer , librarian , teacher, writer, 
scientist, social worker, actor, actress 

I I 10. PROPRIETOR OR OWNER such as owner of a small business, contractor, 
restaurant owner 

O 11/ PROTECTIVE SERVICE such as detective, policeman or guard, sheriff, 
. " fireman 

□ 12. SALES such as salesman, sales clerk, advertising or insurance agent, 

real estate broker 

ri " ^ 

1_| 13. SERVICE such as barber , beautician , practical nurse , .private 
; Household worker, janitor, waiter ' 

□ 14. TECHNICAL such as draftsman, medical, or dental technician,' 

computer prograinmer 



□ IS.' OTHER (specify) 
C 16. DON'T KNOW 
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8. What do you expect to be doing one year after completing high school? 
I I Working full-time 

[""I Entering an apprenticeship or as- the- job training program 
I ] Going into regular military service or to a service academy 
I I Bein~ a full- time homemaker 

["""] Attending a vocational, technical, trade or business school 

[~] Taking academic courses at junior or community college • 

[~] Taking rexrinical or vocational subjects at a junior or community college 

I I Attending a four-year college or university 

I I Working part-time 

I I Other (travel, take a break, no plans) ; . 

9. What is your major field of study? 1 
["""1 General Curriculum 

Vocational Education Curriculum 
IT College Preparatory Curriculum 
I I Other (specify) ; 
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10. Under FATHER , circle the one number that best describes the work done by 
your father (or male guardian);. Under MOTHER, cirlce the one number that 
best describes the work done by your mother (or female guardian) . The exact 
job may not be listed but circle the one that comes closest. If either of 
your parents is out of work, disabled, retired, or deceased, mark the kind 
of work that he or she used to do. . * 

, (Circle one number in each column. X 

Father Mother 

CLERICAL such as bank teHLer, bookkeeper, secretary, 

typist, mail carrier, ticket agent 01 .... 01 i 

• • U . 

CRAFTSMAN such as baker, automobile' mechanic f machinist, 

painter, pluitiberr/—^ carpenter .... 02 .... 02 

FARMER, FARM MANAGER 03 . ; . . 03 J 

HOMEMAKER OR HOUSEWIFE . . . . . 04 .... 04 

^ t . i r m ■ ■ 

LABORER such as construction worker, car washer, 

sanitary worker, farm laborer 05 .... 05 

MANAGER, ADMINISTRATOR such as sales manager r office 'i 
manager, school administrator, buyer, restaurant: 

manager ,- government official . . . 06 .... 06 

MILITARY such as career officer, enlisted man or 

woman in the armed forces 07 v ... 07 

OPERATIVE such as meat cutter, assembler, machine 
operator, welder, taxicab/bus/ or truck driver, 

gas station attendant 08 .... 08 

PROFESSIONAL such as accountant, artist, clergyman, . 
dentist, physician, registered nurse, engineer, 
lawyer, librarian, teacher, writer, scientist, 

social worker, actor, actress - 09 .... 09 

PROPRIETOR OR OWNER such as owner of a -small business, 

contractor, restaurant owner 10 .... 10 , 

PROTECTIVE SERVICE such as detective, policeman or . 
guard, sheriff-, fireman ................ 11 ...» 11 

SALES such as salesman, sales clerk, advertising or 

insurance agent, real estate broker t ... 1*2 .... 12 

SERVICE such as barber, beautician, practical nurse, 

private household worker, janitor, waiter 13 .... 13 

TECHNICAL such as draftsman, medical or dental 

technician, computer programmer 14 ... . 14 
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11. What is your main reason for joining this program? 

[~| Dissatisfied with last year's school program 
!~] Want more information on .careers 
\^~\ Want a more personalized program 
f~l I heard it's an easy program 
[ | Other (Specify) . 

12. What activities* did you participate in at. school last year? 

1. School Newspaper 

2. Drama Club 

• '". 3. Chorus •_ 

4. Band or Orchestra . 

5. Cheerleader '_ 

6. Team Sports 

7. Individual Sports 



Other (Specify) 



13. How many school friends did you have lasx year with whom you interacted 
socially (outside of school hours) at least once a week? 



None 

I to 5 
6 to 10 

II to 15 
15 or more 



14'. How many of your brothers and sisters dropped out of school? 

None 

• One 

T wo 
Three . 



Jour ' 
Five or More 
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FY 1 75 Data Analysis Plan 
For 

Internal Summative * Evaluation 

Introduction 

The Data Analysis Plan presented in this document summarizes the 
specific techniques and analytical procedures to be used by AEL in 
treating the data collected during the execution of the Internal Sum- 
mative Evaluation Plan . Since the external design has not yet been 
made available by the external summative evaluation contractor, this 
document makes no attempts to coordinate such activities at this time 
but merely delineates those analytical procedures pertinent to providing 
AEL with evidence regarding product effectiveness. 

Groups c 

The analyses will be performed on data gathered from the experi- . 
mental and control groups which were established during the institution 
of the pre-treatment recruitment selection procedures. 

These groups are designated as. follows: 

El Randomly selected new experimentials 

E2 Non-randomly selected experimentals: 

CI Randomly selected controls 
7 C2 Non-randomly selected controls 

Kl KCSS/EBCE students 
Groups El and CI w.ere established in order that direct comparisons 
under experimental design ' conditions could be made. Groups E2 and C2. 
are comprised of various combinations of students (e.g., students 
from last year, volunteered as controls) and can be used for investi- 
gations under quasi-experimental conditions. Group Kl consists .of 
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those studepts enrolled at Charleston High School in a nearly autono- 
mously-operated EBCE situation. - 

Instruments n 

Data will be gathered from these groups through the administration 
of the following instrument?: 

1. Student Demographi c Data Questionnaire (SDQ) - This instrument 
was constructed by the evaluation staffs of all four EBCE projects to 
provide common data on basic characteristics. 

2. Comprehensive Tests of Basic Skills (CTBS) -This is a standard- 
ized test of basic academic performance. The reading comprehension, 
arithmetic concepts, and arithmetic applications subtests were used, 

3. " Career Maturity Inventory (CMI) - This is a standardized test 
of career attitude and several areas of career-related competencies. 

4. Assessment of Student Attitudes - This instrument assesses 
students' atti VJdes- and opinions about their academic and career "educa- 
tion programs. 

The SDQ was administered to all' groups at the beginning of the 
school year to gather information on non-criterion variables. The 
CTBS will be used in a pre-post fashion to assess program effects. The 

c 

CMI and the ASA will be administered as, post-treatment instruments to 
groups El, CI, E2 , and C2 and in a pre-post fashion to the Kl group. 

Primary Hypotheses 

The following major hypotheses will.be tested under experimental 
design conditions. All deal with one year effects of the AEL/EBCE 
Program: t 
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1. Experimental students (El) will acquire increased (p<.10) 
mastery in basic academic skills. • 

or 

2. Experimental students (El) will acquire significantly greater 
(p<.10) mastery in basic academic skills than control students (CI) in 
a traditional high school. 

3. Experimental students (El) will acquire significantly greater 
(pc.10) mastery in career knowledge than control students (CI) in a 
traditional high school. 

4. Experimental students (El) will acquire significantly greater 
ip<.10) career maturity than control students (CI) in a traditional 
high school. 

5. Experimental students (El)^will develop significantly more' 
positive (p<.10) attitudes toward learning environments than control 
students (CI) in a traditional high school. 

Analyses 

Statistical- analyses have been selected to test the main effects 
associated with each hypothesis. These analyses are listed below and 
are numerically keyed to hypotheses. 

./ 1. Descriptive statist nd correlated t-tests on pretest and 

posttest scores of El group on CTBS. 

2. a. Descriptive statistics of El and CI pretest and posttest 
CTBS scores. 

2.b.' Analysis of variance on/pretest CTBS scores of El and CI 

y 1 f ■ «- ■ 

( \.;;, V; ' • - 

groups. • • 

2.c. Analysis of variance or covariance (depending on 2.b.) on 
posttest CTBS scores of El and CI groups. 

. .. - c 
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3. a. Descriptive statistics of El and CI posttest scopes on CMI 
Competency Subtests. 

3. b. Analysis of variance on posttest CMI Competency Subtest 
scores of El and CI groups. 

4. a. Descriptive statistics of El and CI posttest scores on CMI 
Attitude Scale. 

■ 4.b. Analysis of variance on posttest CMI Attitude Scale scores 
of El and CI groups . 

5. a. Descriptive statistics of El and CI ASA posttest ratings. 
5.b. Analysis of variance on posttest ASA ratings of El and CI 

groups. 

In addition to the testing of main effects, it; is possible to study 
other effects associated with each hypothesis. Such investigation- 
could consider variables such as sex, grade level, attendance, present- 
ing levels, and demographic data. These analyses will be factorial in 
nature, utilizing grade level, experimental condition, and "achievement 
level as classification factors. 

Analysis 1 tests the hypothesis that El students gain significantly 
in basic skills mastery. The 2 series of analyses are designed to test 
the significance of differential growth in basic academic skills by the 
El.ai. . CI group. Analysis 2a describes the growth of the El and Ci 
groups in basic skills. Analysis 2b tests the equivalence of the El 
and CI groups at the beginning of the year and indicates the type of 
.ana 1 y s_ ia- ~n e eded— -i-rr ~2 c — An'aly s±s~~2 cr tes± s'-the significance of. the dif- 
ference of increases in mastery of basic academic skills by the El 'and 
CI groups . 
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The 3 series of analyses test' the significance of differences in 
El and Cl mastery of career knowledge. Analysis 3a describes the El 
and Cl posttest mastery of career knowledge. Analysis 3b tests the sig 
nificance of differences in mastery of career knowledge by the El a*- t . 
Cl groups* 

The 4 series -x>f analyses are designed to test the significance 
of differences of El and Cl career maturation* Analysis 4a describes 
the El and Cl groups on this measure. Analysis 4b tests the signifi- 
cance of differences in the career maturation of the El and Cl groups. 

The 5 series of analyses tests the effect of the Career Education 
Program on student attitudes toward learning environments* . Analysis 
5a describes El and Cl attitude toward learning environments. Analysis 
5b tests the significance of differences in El and Cl attitude toward 
learning environments. 

Secondary Hypotheses 

The following hypotheses will also be investigated as part of the 
data analyses associated with the implementation of the Internal Summa- 
tive Evaluation Plan : 

6. Experimental students (Kl) will acquire increased (p<.10) 
mastery in basic academic skills . 

7. Experimental students (Kl) will acquire increased (p<.10) 
mastery in career knowledge. v 

8. Experimental students (Kl) will acquire increased (p<.10) 
career maturity. 

9. Experimental students (Kl) will acquire'- positive, .attitudes • 
toward their learning environments. ' u 
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Analyses 

Statistical analyses have been selected to test these secondary 
hypotheses. These analyses are listed below and are numerically keyed 1 
to hypotheses. 

6. Descriptive statistics and correlated t-test on pretest and 
pdsttest scores of Kl group on CTBS. \ 

7. Descriptive statistics and correlated t-test on pretest and 
posttest scores of Kl group on CM I Competency Subtests. \ 

8. Descriptive statistics and correlated t-test on pretest and 
posttest scores of Kl group on CMI Attitude Scale. 

9. Descriptive statistics of Kl group on ASA posttest ratings. 

Tertiary Hypotheses 

Parents, employers , and EBCE graduates will also be administered 
appropriate assessment instruments to determine their attitudes toward 
the EBCE Program (parents and employers) or toward learning environments 
or job satisfaction (graduates) . The following hypotheses associated 
with these topic areas will be investigated: 

10. Parents of . EBCE students will' have positive attitudes toward 
the EBCE Program. 

11- Various levels of employers (i.e., resource persons, contact 
persons, or. managers) will have positive attitudes toward the EBCE 
Program.' . 

12. Graduates of the EBCE Program will demonstrate positive atti- 
tudes toward learning environments (if students) or demonstrate job 
satisfaction ' (if employed) . 
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Analyses 

Statistical analyses have also been selected to test these tertiary 
hypotheses. These analyses are listed below and again are , numerically 
keyed to hypotheses. 

10. Descriptive statistics of parental questionnaire. 

11. Descriptive statistics of employer questionnaire. 

12. Descriptive statistics of graduate questionnaire^.* 

Additional Procedures 

Other information not related to hypothesis testing will also be 
analyzed to provide descriptive information on the respondent groups.- 
Additional hypotheses may result from analysis of the descriptive infor- 
mation. Nevertheless , -descriptive statistics on demographic data will 
be obtained. 
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Name of Instrument ; Comprehensive Tests of Basic Skills 1 (CTBS) 

Rationale/Objective : The CTBS were designed to provide improved measure- 
ment of the extent to which individual students have developed basic 
academic skills. There are four levels of the tests with alternate 
forms for each level. 

Item Content : The CTBS battery booklet (Level 4) includes tests in four 

basic skills areas: reading, language, arithmetic, and study skills. 
The four areas are divided into 10 separately-timed tests, each 
; utilizing a multiple-choice item format. The 10 tests of the CTBS 
and a brief description are as follows:. 

Test 1 - Reading Vocabulary - This 40-item test provides a measure- 
ment of a student's ^Jbility to select the word that has the 
best meaning . 

Test 2 - Reading Comprehension . This 45-item test is composed of 
blocks of items which test the reading cf such selections as 
articles, stories, poems, and letters., 

i 

Tesc 3 - Language Mec hanics., This 25-item test measures a student ! s 
ability to punctuate and capitalize. 

Test 4 - Language Expr ession. This 30-item test measures the 
correctness and effectiveness of expression. 

Test 5 - Language Spelling . This 30-item test measures the student's 
ability to recognize correct and incorrect spelling of wo s. 

Test 6 -.Arithmetic Computation . This test consists of 48 items 
equally distributed among the four arithmetic operations: 
•addition, subtraction, multiplication, and division. 

Test 7 - Arithmetic Concepts . This 30-item test measures the student's 
ability to recognize and/or -apply the appropriate concept and 
technique; the' ability to convert concepts from one form to 
another; the ability to comprehend numerical concepts and under- 
stand their interrelationships; and the ability to organize all 
facts in. ..more complex problems. 

Test 8 - Arithmetic Applications . This 20~item test measures a 
student 1 s. problem-solving abilities . 

Test 9 - Study Skills Using Reference Materials . This 2Q-item test 
measures the ability to use reference materials - to locate 
various types of information and select the appropriate reference- 
books for specific purposes. 

Test 10 - Study Skills Using Graphic Materi als. This 30-item test 
measures a student's ability to use graphic materials. - 



Comprehensive Tests of Basic Skills, Examiners Manual. CTB/ McGraw- 
Hill f Del Monte Research Park, Monterey, California, 1963. 



Administration Procedures : The CTBS-Level 4 may be completed by any 
student in grades eight through twelve. The CTBS total battery 
^ requires approximately 4h hours (each test has a working time 

and time allotted for instructions) . The instrument can be admin- 
istered en an individual as well as a group basis. The complete 
CTBS battery or any subset of the 10 tests may be administered. 



Scoring Procedures : The publisher furnishes a scoring key for hand-scoring 
or the answer sheets may be sent to the publisher for machine scoring'. 
Percentile conversion tables are available in the manual. k 
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Name of Instrument : Career Maturity Inventory 1 (CMI) 

Rationale/Objective : The CMI was designed to provide an inventory 
or? career choice attitudes and on career choice competencies. 

History of Development : The CMI formerly was entitled the Vocational 
Development Inventory (VDI) . The Attitude Scale of the VDI was 
first administered in 1961-62. The CMI was published in 1963 
and is a result of research and evaluation findings of the VDI 
and of additional career maturity research and definition. 

Item Content: : The CMI provides two types of measures: the Attitude 
Scale and the Competence Test. The Competence Test contains 
five parts. The six parts to the CMI and their descriptions 
are as follows: 

Attitude Scale , This is a measure of the feelings, the subjec- 
tive reactions, the dispositions that the individual has 
toward making a career choice and entering the world of 
work . Five attitudinal clusters are surveyed : involve- 
ment in the career choice process; orientation towards 
work; independence in de~ i <> i on-making ; preference for 
cp.' ^ ' . hoice -actor? conceptions of che career choice 



Comp e t e n cy T e s t . 

Pa: 1 . I' Kiow:"-: • . ; i ;elf .jp\ ■ .sal 

"i'.i: .-ides an invt : 5 Lory of a student's ability to 

jss facility in self-appraisal. 

Part 2: Knowing About Jobs (occupational information) 
This provides an inventory of the student's knowledge of 
the world of work. 

Part 3: Choosing A Job (goal selection) 

This provides .an inventory of the student's orientation 

to the world of work and how to progress in it. 

Part 4: Looking Ahead (planning) 

This provides an inventory. of the student's ability to 
N plan 1 for his/her ** future in the world of work. 

Part 5: What Should They Do (problem-solving) 
This provides an inventory of the student^ aoility to 
solve problems which may confront him in pursuit of 
his career goals. 



^Crites, John O. , Career Maturity Inventory Administration and 
Use Manual, CTB/McGraw-Hill , Del Monte Research Park, Monterey, 
California. 1973 
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Administration Procedures ; The CMI may be completed by any student 
in grades six through twelve (senior year of college for the 
attitude scale) . The CMI can be administered in approximately 
2h hours (each part takes approximately 20 minutes) . The 
instrument can be administered on an individual as well as 
group basis. The complete CMI battery or any subset of the 
six parts of the CMI may be administered. 

Scoring Procedures : The publisher furnishes a scoring key for hand 
scoring or the answer sheets can be sent to the publisher for 
scoring. Percentile conversion tables are available in the 
manual. 



APPENDIX E 
Assessment of Student Attitudes 
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Name of Instrument : Assessment of Student Attitudes 1 (ASA) 

{ Rationale/Obj ective : The ASA was designed to provide an ins trum^t: £\ 
the assessment of student attitudes toward traditional and ^^s. 
traditional learning env' ^onnents . 

Item Content : The ASA includes 26 items which yield four subscal^ 
and a total composite score, 

Subscale 1 , This subscale consists of 7 items which measure 
attitudes toward education in general, 

Subscale 2 . ' This subscale consists of 5 items which measure 
attitudes toward school curriculum. 

Subscale 3 . This subscale consists of 9 items which measure 
attitudes toward school resources. 

Subscale 4 . This subscale consists of 5 items which T*easur$ 
attitudes toward school counseling. 

Composite Score . The totality of 26 items measure overall $4^^^ 
attitudes toward the learning environment. 

Administration Pr ocedures : The ASA may be completed by any secor^\y ^h^£>l 
student. The ASA takes approximately 15 minutes to administers ^^^0 
the item order is randomized, the subscales cannot be admini^^/^3 
separately. 

Scoring Procedures . A scoring sheet has been designed to facilit/^ \# 

hand-scoring of each item and the generation of subscai-^ an<$ ^^^#^0 
scores . 



J-Kershner, K. M. and M. W... Blair. Assessment of Student Att>^^% 

Toward Learning Environments. Research for Better Schools k 
. Philadelphia, Pennsylvania, April, 1975. 
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AMLMOA IWOTiKlM, IL^IBIIMTOK H 



P. 0. BOX 1348 

CHARLESTON, WEST VIRGINIA 25325 
304/344^8371 



Your child has now participated in the Experience-Based Career Education 
(EBCE) program for one' year. It is extremely important that we receive some 
information from you concerning your thoughts and attitudes toward the EBCE 
.program. A -similar questionnaire will be used by other projects throughout 
the country. Your responses are therefore an important part of a national 
attempt to evaluate the EBCE project. , 1 c . 

Your response will be carefully coded so that confidentiality will be 0 
preserved. None of ..the teachers or administrators of the EBCE program will 
see your questions ire-., They will see a summary report of all the question- 
naires. ti 

If you have any questions or concerns about any of the items, please 
feel free to contact me at 344-8371. Please- ' return the questionnaire in the 
enclosed envelope by May 23. 

Thank you 'for again taking your, valuable time to as;sist us in evaluating 
and improving the EBCE program. 

' ■ . . ' Sincerely, 



Joe E. Shively, Ph.D. 
Director of Evaluation 
Experience-Based Career Education 



JES:f jc 
Enclosures 
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• Parent Opinion Survey, 

This survey is meant to give you an opportunity to express your 
opinions about the Career Education Program your son or daughter has been 
participating in. Most of the questions are to be answered on a scale of 
numbers f rom (l) to (fll The' phrases at the top and bottom of eacn set of 
questions indicate what the scale means. A (T)may mean something like 
"Definitely No"; if you feel strongly that the answer to the question is 
No, then you should circle the (I) A(5) may; mean "Definitely Yes"; if you 
feel strongly that the answer is Yes, then you should circle the (5) The 
numbers in between (2, 3, 4) indicate an opinion somewhere in between 
'"Definitely No" and "Definitely Yes". Some scales have different phrases 
buc they all work the same way. ' 

Head the phrase above the numbers so you know what the scale means, 
then read each question, and circle the number which is closest to your 
opinion 1 . ..There are no right or wrong answers ; your thoughts and feelings 
are the important things in this survey. The answers parents give will 
help determine how well the program is doing now and improve it in the 
future. Remember to circle a number for each item. Thank you for taking 
the time to fill out this survey. 
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Career Education Program 
Parent Opinion Survey 

How well does the Career Education Program compare overall with the past 
school experiences of your daughter or son? 

Much 
Better 

1 '2 < 3 - 4 5 



If you had it to. do over again, would you want your son or daughter to 
participate in the Career Education Program? 

De f i ni te ly De f i ni te ly 

NO YES 

1 2 3 ' 4 5 



How well do you think your son or daughter likes the Career Education 
Program compared with past school experiences? 

. Much • ■ " ' ' ' : ' Much 

Worse Better 

1 ' 2 3 4 5 



What do you think are the greatest weaknesses of the Career Education 
Program? 



Much 
Worse 



What" do you think are the greatest strengths of the Career Education 
■Program? 



138 



6. °Have you received enough information about your son's or daughter's 
progress in the Career Education Program? 



De finitely 
NO 



Definite ly 
YES 



In comparison with regular schools how much opportunity did the Career 
Education Program provide your daughter or son for learning about 
occupations? 



8. 



9. 



Much 
Less 



Much 
More 



What effect, if any, has the Career Education Program had on helping your 
.son or daughter form career plans? 



Definitely 
Bad 



Definite ly 
Good 



In comparison with regular schools , how much opportunity did the Career 
Education Program provide your u,. ' r ~"iter or son for general learning? 



10, 



Much 
Less 



About the 
Same 



Much 
More 



In comparison with past experiences in i' ^ular schools, how motivated is 
your daughter or son to learn in the Career Education Program? 



Much 
Less 



About the 
Same 



Much 
More 



11. How would you rate the approaches to learning used in the Career Educa- 
tion Program? " 



Poor 
1 



Excellent 

4 «5 
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12. • What positive changes have you noticed in your son or daughter that might 
be a result of participation in the Career Education Program? 



13. What: negative changes have you noticed in your son or daughter that might 
' be a result of participation in the Career Education Program? 

\ , . * , — . — — ■ — ■ ■ — 



14 . How' often does your son or daughter talk to you about what's going on in 
the Career Education Program? 



Almos t 
Never 



Almos t 
Daily 



15. About how often have you had any contact with any Career Education Program 
staff members? . 



Almost 
Never 



.1 



Very 

Frequently 



16. 



How many meetings have you attended during this' school year where other 
parents of Career Education students were present? 



None 



4 or More 



17. How would you rate the general quality of the Career Education Program 
staff? 



Poor 
1 



Excellent 
5 



167 

ERLC 



140 



18. 



19. 



21. 



22. 



How would you rate the business or community resources available in 
the Career Education Program? ' 



Poor 
1 



Excellent 
5 



How would you rate your overall relationship with the staff of the 
Career Education Program?. 



Poor 
1 



Excellent 
5 



20- How would you rate the enthusiasm of the Career ' Education Program staff? 
Poor Excellent 
1 2 3 4 5 



What do you think of the occupational plans of your daughter or. son? 

a. J^j There aren't any firm plans yet. 

b. 1 | The plans should be changed. 

c. | 1 The plans seem to be good. 

d. We haven't really had a chance to discuss the plans. 

What do you think your son or daughter will be doing a year after high 
school? 

a. Working 

b. J^jj Attending some kind of college 

c. |\' [ Going to a business or trade school 

d. - £H Military 

e. Q Other (please specify) . 
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23. Below are listed areas of possible importance for a student to learn. 

Please rate each in terms of how important you feel it is for a student 
to learn, and how well you feel the program is accomplishing each. 



Students learn to: 

a. Perform specific occupational skills 

b. ' Be punctual and organize their time 

c. Assume responsibility for themselves 

d. Make decisions and follow through 

e. Communicate with others in a 
mature way 

. f . Be aware of more career 
opportunities 

g. Work with others 

h. Evaluate their own work 

i. Perform basic academic skills 

j. Think through and solve problems 

k. Have a positive attitude toward self 

1. Have a positive attitude toward work 

m. Have a positive attitude toward 
learning 

n. Prepare for further education 

o. Improve . interpersonal and social 
skills * ' 

p.. . Other (please specify) 



How 
You 


Important Do 
Peel This 




Learning 


IS? 






Not 
Impor- 
tant 




Highly 
Impor- 
tant 


1 


2 


3 


A 


~j 


1 


2 


3 


A 
*i 


3 


i 

1 


2 


3 


4 


J 


~ 1 


2 


3 


.4 . 


5 , 


1 


2 


3 


4 


5 


1 ■ 


2 


3 


4 


5 


1 


2 


3 


4 


5 


1 


2 


3 


4 


5 


1 


2 


3 


4 


5 


1 


2 


3 


4 


5 


1 


2 


3 


4 


S 


1 


2 


3 


4 


5 


1 ' 


2 


3. 


4 


5 ' 


1 


2 


3 


4 


5 


1 


2 


3 


4 


5 


1 


2 


3 


4 


5 



How Effective Do 
You Feel the 
Project Has Been / 
In Accomplishing •'- 
This Learning? 


Not 
Effec- 
tive 




Highly 
Effec- 
tive . 


1 2 


3 


4 5 


1 2 


3 


4 5 


1 2 


3' 


4 5 


1 2 


3 


4 . 5 , 


1 2 


"3 


4 5 


1 2 


3 


4 5 


.12 


3 


4 5 


1 2 


3 


4 5 


1 2 


3 


4 5 


1 2 


3 


4 5 


1 2 


3 


4 5 


1 2 


3 


4 5 


1 2 


3 


4 5 


1 2 


3 


4 5 


1 2 


3 


4 5 


1 2 


3 


4 5 
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24. How did you first hear about the Career Education Program? 



25. What kinds of students do you think benefit most from Career Education 
Program? 



1 7 u 
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AEL : EBCE : 5-13-75 



EMPLOYER INTERVIEW INSTRUMENT 

Setting Up Appointment 

1. .Determine who should be called (contact person) 
2- Phone and introduce self 
. 3. Identify purpose of study 

a. End-of-year evaluation 

b. Program revisions FY 1 7 5 

c. Provide project staff with information 
4." Set up appointment 

Interview Procedures 

1. .Introduce self 

2. Review reason for study 

Note: (Maintain a very re • ed informal atmosphere 

throughout the interview. The contact person 
should be free to ramble if necessary-) 

• ; "3; Record information that answers specific questions 

7 

z 

^plus any additional comments you feel are important. 
Information 



Name of Contact Person 



Name of Resource Person (if any) 
Name of Company . 



Questions 

1. Did the EBCE staff provide you with the necessary information 
to help you direct students' activities at your, site? 
Yes No Sometimes 
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it Probe: 

Did the EBCE staff usually show you the : 
Student Activity Sheet (s) 

Student Program Profile (Explain, if necessary) 

, T ype of products expected from student ' ^ 

Explain reason for the particular placement 
rrovide you with feedback on student's progress 
2. Which of the following supportive services do you (or others 

at your site) provide for the Experience-Based Career Education 
(EBCE) program students? (Check each appropriate category.) 

Frequently Occasionally Seldom Never 

Do you talk about j ob 

opportunities? 

Do you talk about the 

students' personal problems? " , . 

Do you talk about activities 

at your site? . 

Do' you tutor in an 

academic area? _ ' '•_ 

Do you evaluate individual 

students' assignments? 

Do you assist students in non- 
job related ass ignments? ; 

Do you supervise students to - - 

perform a specific job-related 

task at your site? _ 

Do ' you help plan student 

assignments? : 

Other (specify) 



•4 r-; 
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3. How do students spend their time at your site? (Check each 
appropriate category.) 

Frequently Occasionally Seldom Never 

B 

Observing site activities _j 

Researching from site materials t 

Actively performing site 

activities , 

Talking with me • — ; 

Talking with other site 

personnel 

Individual study 

Other (specify) 

4. Do you think the EBCE students have been interested in your site? 
Yes No Don 1 1 know ^ 

(Probe, if you think the contact" person would like to continue 
talking about this area.) 

5. Based on the EBCE students placed at your site, do you feel 
these students were interested in the concept of EBCE? 

Yes No . Don't know__ 

6. How have employees at your site" reacted to the EBCE students 
placed at your site? ; ; 



7. How has top level management reacted to the EBCE students 
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Have you been satisfied with the feedback that you 

relating to what happens to the student after he y^U^ 

site? Yes_ No (Probe, if you can J 



10. 



Do you think your company will continue working wit) 4 f^Z& 
project during the next couple of years? 
Yes No Don't know 

Based on the students and staff you've met, how ef£^tf\ ^ 
you feel the program was? 



11. Do you feel, the program functioned as you were led ^ tf^\^\r0 
when you were recruited as an employer site? * 
Yes No^ Don't know_j 

12. What do you feel the strengths of the EBCE Program 



13. What do you feel the weaknesses- of the EBCE Prograrr\ 



14. To what extent has the EBCE Program had an impact otf * * / n • ? 
• (Check each appropriate category.) 



How Much Impact 
No Some Much Don't 

Impact ' Impact Impact Know 



a. Quality of work 
performed . y . 

• re gu la r emp loy e e s 

b. Amount of work 
per-formed by 
regular employees 



Good ^ D Cn ft 

Impacf j?V 0 * Kx\ov?< 
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c. Company hiring 
practices 

a. Company training 
practices , 

e* Other possible 
impacts (List. ) 



How Much Impact 
No Some Much Don 1 1 

Impact Impact Impact Know 



Value of Impact 
Good Ba£ " Don't 
Impact Impact Know 



V 
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APPENDIX H 
EBCE Graduate and Dropout Questionnaire 
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In the EBCE Program (AEL) 
From 



To 



■ (month) (year) 


(month) 


(year) 


EBCE GRADUATE AND DROPOUT QUESTIONNAIRE 

Date: 




NAME 


SEX: M a 


F 


PRESENT ADDRESS 


Street 


City State 

PERMANENT ADDRESS . 




Zip Code 


Street 

r > ' 


City State 

PRESENT SHONE - 

First Contact. 




Zip Code " ■, 


(month) 
Second Contact , if any: 


(day) 


(time) 


■- (month) 

Other "Contacts , if any: 


(day) 


(time) 


' ; ■ (month*) ■ " 


(day) 


(time) 


(month). 

■j 


(day) 


'(time) 


(month) 

Time of Interview: 


(day) 


~(time) 


(month) 

,Name of Interviewer: 


(day) 


(time) 

0 



Interview Comments: 
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1. First, I'd like to know your marital status. 
Single 

Married 

Separated 

Divorced 

Other " 

2. With whom do you live? 
Parents 

Relatives 

Friend (s) 

Alone 

Other 

3. What is your main present activity? (CHECK ALL THAT APPLY.) 
Unemployed — not looking for work 

Unemployed — looking for work 

Housewife 

Full-time student (taking at least 12 semester hour's) 

_Part-time student (taking less than 12 semester hours) 

Working part-time , 

Working full-time 

(••IF RESPONDENT IS UNEMPLOYED AT THIS TIME , ASK #4.) ** 

4. -Have you ever worked' since you grar* ' "\ed from EBCE? ' _' Y es No 

(IF "YES," ASK RESPONDENT, QUESTION. ..-18; IF "P," ASK QUESTIONS 5-7 S- 19 .) 

5. Were there any jobs you tried for but didn't ge'~? Yes No 

(IF "YES" ASK RESPONDENT QUESTION 6; IF " NO , " SKIP TO QUESTION 7.) 

6 . Why do you think you didn 1 1 get the j ob/ j obs? 



1 7 9 
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THE FOLLOWING QUESTION SHOULD BE ASKED OF ALL STUDENTS WH, HAVE LOOKED FOR WORK. 

7. How much difficulty would you say you have had in getting work since you left 
the EBCE program? 

No difficulty 



Some difficulty 



Much di f f i cul ty 



What kind of difficulty? (PROBE) 



(IF RESPONDENT SAYS HE/SHE HAS EVE? WORKED SINCE LEAVING EBCE, ASK QUESTIONS 8 
THROUGH 13. IF HE/SHE IS GOING TO SCHOOL , SKIP TO QUESTION l"/.) 

8. What kind of work are (or were) you doing? 

RECORD ANSWER, THEN CODE ACCORDING TO OCCUPATIONAL LIST. 

Brief Description of Job Occ. Code 

9- How long have ' ou had (or did you have) this particular job? months 

10. Describe the. .other full-time jobs you have had since you left EBCE? 
RECORD ANSWERS, THEM CODE ACCORDING TO OCCUPATIONAL LIST. 



Brief Description of Job 


Occ. 


Code 


Brief Description of Job 


Occ. 


Code 


Brief Description of Job 


Occ. 


Code 


11. What is (was) your main reason for working? 







(LET RESPONDENT' VOLUNTEER MAIN REASON • THEM SAY:) 
Can you think of any other 'sons? What were they 0 
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12. How man* hours do you work a week on the average? 
1- 4 hours 

5-10 hours ^ 

11-20 hours 

21-30 hours 

31-40 hours 

Over 40 hours 

13. When you look back and compare the course of your career so far with that of 
people about your age f =are you: (INTERVIEWER CHECK ONE.) 

Much less satisfied with your career than they are? 



Somewhat less satisfied with your. career than they are? 



About as satisfied with your career as they are? 



^Somewhat more satisfied with your career than they are? 
Much more satisfied with your career 'than they are? 



14. When you compare how the rest of your career is likely to turn out with how 
the careers of people your age are likely to turn out, are you: 

Much less satisfied than they are? 



Somewhat less satisfied than . they are? 
About as satisfied as th ;y are? 
Somewhat more satisfied than they are? 



Much more satisfied than they are? 



15. Would you like to work at your present job 5 years from now? (INTERVIEWER 
I. READ. LIST WHICH FOLLOWS AND RECORD ANSWERS,) 

Definitely , Probably - not 



Probably - Definitely not 

Uncertain » 
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16. Would you rather have some other job? Yes No Unsure 



17. What kind of a job would you like to have in the next five years? 

RECORD ANSWER, THEN PROBE TO GET ENOUGH INFORMATION TO CODE RESPONSI 
ACr "-VTNG TO OCCUPATIONAL LIST. 



Brief Description of Job Occ. Code 

18. I am going to read you some items which scribe various aspects of jobs. 
Please tell me how satisfied you are W7 • " this aspect of your present job. 

■ (INTERVIEWER: CIRCLE APPROPRIATE NUMBER.) 

Very Very Not 

Dissat . Sat . Applicable 

Earnings 12 3 4 5 NA 

OThe duties of the job 12 3 4 5 NA 

Job security 12 3 4.5 NA 

The ar .it of responsibility I have 1 2 3 4 5 NA 

Opportunity for promotion or 

advancement 12 3 4 5 NA 

Benefits (insurance, sick pay, 

pension plans, etc.) 12 3 4 5 NA 

Opportunities to use my knowledge 

and ability 12 3 4 5 NA 

Getting along with fellow workers 12 3 4 5 NA 

The kind of supervisor' I have 1 2 3 4 5 NA 

Physical working conditions 12 3 4 5 NA 

19. Are you participating in any educational or training program? (IF n N0 M . 
SKIP TO QUESTION 26.) Yes No 

If so, what type of training program are you now participating in? 
(INTERVIEWER CHECK ONE.) 

4-year college or university 

. Junior or community college 

Vocational or technic \\ school 
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^Business school 
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Trade School 



Armed Services training program 

Training program run by person's employer 

Other (specify) ^_ 

20. What are (were) you studying or learning about? 

RECORD ANSWER, THEN CODE ACCORDING TO THE OCCUPATIONAL LIST. 

Brief Description of Job Occ. Code 

21. How long have you been (were you) in this educational program? months 



22. What other educational programs have you been in since you left the EBCE. 
program. . 



3rxef Description of Program Subject Matter Occ. Code 



Brief Description of Program Subjec- : Matter Occ. Code 



23. Are/were you satisfied with the educational or training programs you are/ 
were in? Yes No Not sure 



24. What is/was your main reason for being/having been in this educational 
program(s)? 

To pursue a chosen carear 



To find a career 



Did not know what else to do 



Pressure from parents 



Pressure from friends 



Could. not .find work 



To learn more about a particular subject or skill 



.25. Can you think of any other reason? If so, what is/was it? 
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?6. What kinds of subjects or s- ills would you like to learn about in the next 
five (5) years? „__^ _ 

RECORD ANSWER, THEM PROBE TO GET ENOUGH INFORMATION TO CODE RESPONSE 
ACCORDING TO THE OCCUPATIONAL LIST . 

Brief Description of Job Occ. Code 

27. What is the level of formal education that you ;clan to complete? 



PROBE TO GET RESPONSE THAT CLASSIFIES INTO ONE OF THE FOLLOWING CATEGORIES . 
PROMPT RESPONDENT BY READING OFF THE LIST UNTIL HE SAYS YES, CHECKING THE 
HIGHEST LEVEL MENTIONED. 

Don f t know, haven't thought much about it 

H igh school diploma or equivalency 

One-year College Certificate 

Business School Certificate 

Vocational, Technical, or Trade School Certificate 
Two-year College Certificate 

Four-year College Degree 
Master ' s Degree 

D octor's Degree 

O ther (specify) . . : 

28.. Realistically, how much money would you like to be making five years from 
now? $ 

NOW I'M GOING TO ASK YOU SOME QUESTIONS ABOUT THE TIME YOU SPENT IN EBCE. 

a 

29,' What did you like best about the EBCE program? 



30. What did you dislike most about the EBCE program? 
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31. „:ov much do ycu feel you learned whi3s you were in the EBCE program? I'm 
going to mention several areas of learning and you can tell me whether you 
feel you learned a lot, seme, a little, or nothing at all. Think about 
each area and then make an estimate of how much you learned about this 
subject or skill. 

ASK THE STUDENT TO USE A PIECE OF SCRATCH PAPER A**D A PENCIL TO WRITE 
>OWN THE RATING SCALi- . SO THAT HE/SHE WILL EE ABl TO LOOK AT IT WHEN 
YOU READ OFF THE AREAa . 

Not at A Don't 

all Little Some A Lot Remember 



Specific job skills 



Career planning 



Awareness of job opportunities 



Job -seeking skills 



Reading skills 



Writing skills 



Math skills 



Ability tc contnunj :.^e with adults 



32. What kind of things did you learn in EBCE that are most useful to you now? 



33. Why did you leave EBCE? ; 

RECORD RESPONSE AND CODE IT ACCORDING TO THE FOLLOWING: 

g raduate—after one year; completed two years - 

dropped out . voluntarily 

was asked to leave 

other (specify) [ 

In general, did the time spent in EBCE have a positive, negative, or no 
effect on your , . . 0 . . 

Positive No Effect Negative - 

Preparation for further education _ _ 

Preparation for jobs \ 
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35. How closely did your first job after graduating relate to your EBCE 
experience? (CHECK ONE ONLY.) 

I was employed in an occupation in which I had EBCE experience. 

I wss employed in a related occupation. 

I was employed in a completely different occupation. 



36. Is there anything more that you would have liked ro have received from the 

EBCE program to assist you in further education or training? Yes No 



If there is f what is it? 



37. Are there any other changes that you would recr .end be made to improve the 
EBCE program? les No 



If so, what are the changes you would recommend? 
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pursuant to Contract No. NE-C-00-4-0008 with the National Institute of 
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expressed in this publication do not necessarily reflect the position or 
policy of the National Institute of "Education and no official endorsement 
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Inc . is an 'equal opportunity employer . 
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